quazim commited on
Commit
cec7240
·
verified ·
1 Parent(s): ab1c7e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
- | arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 | 57.50 | - |
152
- | mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 | 78.10 | - |
153
- | piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 | 81.30 | - |
154
- | winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 | 73.80 | - |
155
 
156
 
157
 
 
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
+ | arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 | 49.90 | - |
152
+ | mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 | 66.40 | - |
153
+ | piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 | 73.30 | - |
154
+ | winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 | 60.0 | - |
155
 
156
 
157