Update README.md
Browse files
README.md
CHANGED
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
|
|
148 |
|
149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
150 |
|---------------|---|---|---|----|----------|------------|
|
151 |
-
| arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 |
|
152 |
-
| mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 |
|
153 |
-
| piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 |
|
154 |
-
| winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 |
|
155 |
|
156 |
|
157 |
|
|
|
148 |
|
149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
150 |
|---------------|---|---|---|----|----------|------------|
|
151 |
+
| arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 | 49.90 | - |
|
152 |
+
| mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 | 66.40 | - |
|
153 |
+
| piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 | 73.30 | - |
|
154 |
+
| winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 | 60.0 | - |
|
155 |
|
156 |
|
157 |
|