Skip to content

Commit

Permalink
Added note regarding behaviour of scheduler to config
Browse files Browse the repository at this point in the history
  • Loading branch information
Rilwan-Adewoyin committed Oct 10, 2024
1 parent 1c9093c commit 1d27b5d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/anemoi/training/config/training/default.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ max_steps: 150000

lr:
rate: 0.625e-4 #local_lr
iterations: ${training.max_steps}
iterations: ${training.max_steps} # NOTE: When max_epochs < max_steps, scheduler will run for max_steps
min: 3e-7 #Not scaled by #GPU

# Changes in per-gpu batch_size should come with a rescaling of the local_lr
Expand Down

0 comments on commit 1d27b5d

Please sign in to comment.