Skip to content

Commit

Permalink
ruff format __init__.py
Browse files Browse the repository at this point in the history
  • Loading branch information
lessw2020 committed Feb 12, 2024
1 parent c5da96d commit 8b940be
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchtrain/models/llama/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
"1B": ModelArgs(dim=1024, n_layers=16, n_heads=8),
"7B": ModelArgs(dim=4096, n_layers=32, n_heads=32),
"13B": ModelArgs(dim=5120, n_layers=40, n_heads=40),
"40B": ModelArgs(dim=5120, n_layers= 80, n_heads= 40),
"40B": ModelArgs(dim=5120, n_layers=80, n_heads=40),
"70B": ModelArgs(
dim=8192,
n_layers=80,
Expand Down

0 comments on commit 8b940be

Please sign in to comment.