End of training
Browse files
README.md
CHANGED
@@ -16,13 +16,13 @@ This student model is distilled from the teacher model [gpt2](https://huggingfac
|
|
16 |
The [Distily](https://github.com/lapp0/distily) library was used for this distillation.
|
17 |
|
18 |
It achieves the following results on the evaluation set:
|
19 |
-
- eval_enwikippl:
|
20 |
-
- eval_frwikippl:
|
21 |
-
- eval_zhwikippl:
|
22 |
-
- eval_loss:
|
23 |
-
- eval_runtime: 0.
|
24 |
-
- eval_samples_per_second: 18.
|
25 |
-
- eval_steps_per_second: 18.
|
26 |
|
27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
28 |
should probably proofread and complete it, then remove this comment.
|
@@ -57,15 +57,15 @@ The following hyperparameters were used during training:
|
|
57 |
- num_epochs: 1.0
|
58 |
|
59 |
### Resource Usage
|
60 |
-
Peak GPU Memory: 1.
|
61 |
|
62 |
### Model Results
|
63 |
| epoch | eval_enwikippl | eval_frwikippl | eval_loss | eval_runtime | eval_samples_per_second | eval_steps_per_second | eval_zhwikippl | step |
|
64 |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
|
65 |
-
| 0 |
|
66 |
-
| 0.5025 |
|
67 |
-
| 0.7538 |
|
68 |
-
| 0.2513 |
|
69 |
|
70 |
### Framework versions
|
71 |
- Distily 0.1.0
|
|
|
16 |
The [Distily](https://github.com/lapp0/distily) library was used for this distillation.
|
17 |
|
18 |
It achieves the following results on the evaluation set:
|
19 |
+
- eval_enwikippl: 3251.3369
|
20 |
+
- eval_frwikippl: 12842.3994
|
21 |
+
- eval_zhwikippl: 91987.7734
|
22 |
+
- eval_loss: 2288.0
|
23 |
+
- eval_runtime: 0.0553
|
24 |
+
- eval_samples_per_second: 18.087
|
25 |
+
- eval_steps_per_second: 18.087
|
26 |
|
27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
28 |
should probably proofread and complete it, then remove this comment.
|
|
|
57 |
- num_epochs: 1.0
|
58 |
|
59 |
### Resource Usage
|
60 |
+
Peak GPU Memory: 1.2452GB
|
61 |
|
62 |
### Model Results
|
63 |
| epoch | eval_enwikippl | eval_frwikippl | eval_loss | eval_runtime | eval_samples_per_second | eval_steps_per_second | eval_zhwikippl | step |
|
64 |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
|
65 |
+
| 0 | 58331.5781 | 58190.1172 | 6944.0 | 0.0763 | 13.107 | 13.107 | 54568.5117 | 0 |
|
66 |
+
| 0.5025 | 2778.4973 | 13039.9355 | 2080.0 | 0.0561 | 17.833 | 17.833 | 100748.5312 | 100 |
|
67 |
+
| 0.7538 | 2581.9565 | 12580.9199 | 2048.0 | 0.0551 | 18.153 | 18.153 | 110134.0156 | 150 |
|
68 |
+
| 0.2513 | 3251.3369 | 12842.3994 | 2288.0 | 0.0553 | 18.087 | 18.087 | 91987.7734 | 50 |
|
69 |
|
70 |
### Framework versions
|
71 |
- Distily 0.1.0
|