Denis commited on
Commit
a8999d3
·
1 Parent(s): c0ee957

End of training

Browse files
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [ai-forever/rugpt3medium_based_on_gpt2](https://huggingface.co/ai-forever/rugpt3medium_based_on_gpt2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.1913
18
 
19
  ## Model description
20
 
@@ -42,7 +42,7 @@ The following hyperparameters were used during training:
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - lr_scheduler_warmup_steps: 1000
45
- - num_epochs: 22
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
@@ -53,6 +53,7 @@ The following hyperparameters were used during training:
53
  | 2.2106 | 10.0 | 10 | 1.6388 |
54
  | 1.1598 | 15.0 | 15 | 0.6276 |
55
  | 0.3638 | 20.0 | 20 | 0.1913 |
 
56
 
57
 
58
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [ai-forever/rugpt3medium_based_on_gpt2](https://huggingface.co/ai-forever/rugpt3medium_based_on_gpt2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.1476
18
 
19
  ## Model description
20
 
 
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - lr_scheduler_warmup_steps: 1000
45
+ - num_epochs: 25
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
 
53
  | 2.2106 | 10.0 | 10 | 1.6388 |
54
  | 1.1598 | 15.0 | 15 | 0.6276 |
55
  | 0.3638 | 20.0 | 20 | 0.1913 |
56
+ | 0.0696 | 25.0 | 25 | 0.1476 |
57
 
58
 
59
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f73d3f4910db0bf4a3241b21c7e732930382dbeb47fb29f96ed28d6c22b90b73
3
  size 1423517184
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:802a403311eaccad438595384b89c0e80bd91bb33555fab03c8b9e6fda625c1e
3
  size 1423517184
runs/Dec22_19-52-01_3eb6c8de2272/events.out.tfevents.1703274725.3eb6c8de2272.747.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6245af7faa500f43a7e5a0c3c459f3ccbf287ec2853c31cc6489462c03e9230c
3
+ size 7410
runs/Dec22_19-53-17_3eb6c8de2272/events.out.tfevents.1703274799.3eb6c8de2272.747.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65d51f3a5430599a030233ab09aacb135119ab81712cd4fd19fb5d594d6ed9ca
3
+ size 6990
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2faae4fc2e0fb34d4b6340062456eaaddd125e5bc1e07b31daedb606977009d7
3
  size 4536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b1e32a685bc26d74fc99ff3eee555a35ba7d3e25ba0f14ddb0ca0b460a81116
3
  size 4536