Denis commited on
Commit
5ba1eb0
·
1 Parent(s): d1fd145

End of training

Browse files
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [ai-forever/rugpt3medium_based_on_gpt2](https://huggingface.co/ai-forever/rugpt3medium_based_on_gpt2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.3125
18
 
19
  ## Model description
20
 
@@ -42,7 +42,7 @@ The following hyperparameters were used during training:
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - lr_scheduler_warmup_steps: 1000
45
- - num_epochs: 30
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
@@ -53,6 +53,7 @@ The following hyperparameters were used during training:
53
  | 0.858 | 13.95 | 200 | 0.4355 |
54
  | 0.7697 | 20.93 | 300 | 0.3482 |
55
  | 0.6343 | 27.91 | 400 | 0.3125 |
 
56
 
57
 
58
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [ai-forever/rugpt3medium_based_on_gpt2](https://huggingface.co/ai-forever/rugpt3medium_based_on_gpt2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.3788
18
 
19
  ## Model description
20
 
 
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - lr_scheduler_warmup_steps: 1000
45
+ - num_epochs: 40
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
 
53
  | 0.858 | 13.95 | 200 | 0.4355 |
54
  | 0.7697 | 20.93 | 300 | 0.3482 |
55
  | 0.6343 | 27.91 | 400 | 0.3125 |
56
+ | 0.5486 | 34.88 | 500 | 0.3788 |
57
 
58
 
59
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:414be22f741a1ce18a2a50fd06220ce1122e699d9fe79d0fc19bc7ced2259d9e
3
  size 1423517184
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec537447e6aacbae0ef5403f98d16ae87f0401bab3e5ca8b6072edada1e55aa5
3
  size 1423517184
runs/Dec22_19-40-42_3eb6c8de2272/events.out.tfevents.1703274051.3eb6c8de2272.747.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f99c426becbcc1b854a61178fc7c5092dd2a16e68b6fd6a812ee91cabdfdb0e0
3
+ size 7032
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03d3628a82b54f48e6868b8c475746728044b98893635fbf9132ad4a3a68aa4c
3
  size 4536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0de7fd704906bbd1651828a08d4985b88ae85a99f603e7868d3c32b33f102320
3
  size 4536