lapp0
/

gpt2_model_card_distily_test

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

lapp0 commited on Aug 5, 2024

Commit

9d3cbc0

·

verified ·

1 Parent(s): 37ed7e9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -58,7 +58,7 @@ Peak GPU Memory: 1.2453 GB
 ### Model Results
 | epoch | step | eval_enwikippl | eval_frwikippl | eval_loss | eval_runtime | eval_samples_per_second | eval_steps_per_second | eval_zhwikippl |
 | --- | --- | --- | --- | --- | --- | --- | --- | --- |
-|  | teacher | 30.2266 | 57.3005 |  |  |  |  | 18.1903 |
 | 0 | 0 | 53288.7773 | 55702.1719 | 0.0041 | 0.0758 | 13.185 | 13.185 | 55025.875 |
 | 0.4040 | 40 | 20265.3535 | 39300.7383 | 0.0004 | 0.0554 | 18.059 | 18.059 | 53151.6875 |
 | 0.8081 | 80 | 17527.1328 | 38131.125 | 0.0004 | 0.0553 | 18.096 | 18.096 | 51728.4688 |

 ### Model Results
 | epoch | step | eval_enwikippl | eval_frwikippl | eval_loss | eval_runtime | eval_samples_per_second | eval_steps_per_second | eval_zhwikippl |
 | --- | --- | --- | --- | --- | --- | --- | --- | --- |
+|  | **teacher** | 30.2266 | 57.3005 |  |  |  |  | 18.1903 |
 | 0 | 0 | 53288.7773 | 55702.1719 | 0.0041 | 0.0758 | 13.185 | 13.185 | 55025.875 |
 | 0.4040 | 40 | 20265.3535 | 39300.7383 | 0.0004 | 0.0554 | 18.059 | 18.059 | 53151.6875 |
 | 0.8081 | 80 | 17527.1328 | 38131.125 | 0.0004 | 0.0553 | 18.096 | 18.096 | 51728.4688 |