Skip to content

Commit

Permalink
ufmt whitespace fix
Browse files Browse the repository at this point in the history
  • Loading branch information
lessw2020 committed Feb 14, 2024
1 parent 26ac429 commit dc29cb5
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion torchtrain/models/llama/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -394,7 +394,6 @@ def __init__(self, layer_id: int, model_args: ModelArgs):
self.ffn_norm = RMSNorm(model_args.dim, eps=model_args.norm_eps)
self.weight_init_std = 0.02 / (2 * self.num_layers) ** 0.5


def forward(
self,
x: torch.Tensor,
Expand Down

0 comments on commit dc29cb5

Please sign in to comment.