VictorFiz
/

TinyLlama_v1.1_2bit_int_llama2_7b_teacher

Model card Files Files and versions

Metrics Training metrics Community

VictorFiz commited on Mar 24

Commit

8597dcd

·

verified ·

1 Parent(s): de7a174

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ license: mit
 |PPL|  arc_easy  |arc_challenge|    piqa    | winogrande | hellaswag  |mmlu|QA Avg|
 |---|------------|-------------|------------|------------|------------|----|------|
-|-  |36.91 ± 1.00|20.14 ± 1.00 |60.28 ± 1.00|53.99 ± 1.00|33.00 ± 1.00|-   |-     |
 Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)

 |PPL|  arc_easy  |arc_challenge|    piqa    | winogrande | hellaswag  |mmlu|QA Avg|
 |---|------------|-------------|------------|------------|------------|----|------|
+|16.94  |36.91 ± 1.00|20.14 ± 1.00 |60.28 ± 1.00|53.99 ± 1.00|33.00 ± 1.00|-   | 40.86 |
 Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)