TheStageAI
/

Elastic-Mistral-Small-3.1-24B-Instruct-2503

Text Generation

text2text-generation

Model card Files Files and versions Community

psynote123 commited on Jun 2

Commit

85fa502

·

verified ·

1 Parent(s): f9a40c0

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -148,11 +148,11 @@ Benchmarking is one of the most important procedures during model acceleration.
 | Metric/Model  | S | M | L | XL | Original | W8A8, int8 |
 |---------------|---|---|---|----|----------|------------|
-| arc_challenge | 65.30 | 66.30 | 66.70 | 66.80 | 66.80 | 64.20 | - |
-| gsm8k | 87.70 | 88.40 | 87.70 | - | - | 87.60 | - |
-| mmlu | 79.00 | 79.40 | 79.70 | 80.20 | 80.20 | 78.90 | - |
-| piqa | 82.90 | 83.10 | 82.60 | 83.00 | 83.00 | 81.80 | - |
-| winogrande | 78.20 | 79.40 | 79.30 | 79.50 | 79.50 | 76.00 | - |

 | Metric/Model  | S | M | L | XL | Original | W8A8, int8 |
 |---------------|---|---|---|----|----------|------------|
+| arc_challenge | 65.30 | 66.30 | 66.70 | 66.80 | 66.80 | 51.10 | - |
+| gsm8k | 87.70 | 88.40 | 87.70 | - | - | 13.49      | - |
+| mmlu | 79.00 | 79.40 | 79.70 | 80.20 | 80.20 | 60.45      | - |
+| piqa | 82.90 | 83.10 | 82.60 | 83.00 | 83.00 | 75.35      | - |
+| winogrande | 78.20 | 79.40 | 79.30 | 79.50 | 79.50 | 71.19      | - |