Spaces:
Sleeping
Sleeping
File size: 181 Bytes
2e4e57e |
1 2 3 4 5 6 7 8 9 10 |
import optimizer_config
training_loop.Trainer:
learning_rate_schedule = @optimizer_config.lr_rsqrt_decay
optimizer_config.lr_rsqrt_decay:
max_lr = 0.05
min_lr = 0.001
|