ChromiumPlutoniumAI commited on
Commit
f9583c8
·
verified ·
1 Parent(s): 667287d

Create training_config.yml

Browse files
Files changed (1) hide show
  1. training_config.yml +7 -0
training_config.yml ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ training:
2
+ batch_size: 4
3
+ epochs: 3
4
+ learning_rate: 2e-5
5
+ gradient_accumulation: 8
6
+ mixed_precision: "fp16"
7
+ save_steps: 500