Update README.md
Browse files
README.md
CHANGED
|
@@ -223,9 +223,9 @@ mmlu_pro_plus_en_biology
|
|
| 223 |
|-------|------:|--------------|-----:|-----------|---|-----:|
|
| 224 |
|biology| 1|custom-extract| 5|exact_match|↑ |0.3453|
|
| 225 |
|
| 226 |
-
| Tasks |Version|Filter|n-shot| Metric | |PD-Gemma 3n-E4B | E4B IT
|
| 227 |
-
|---------------------|------:|------|-----:|--------|---|-----:| -----:|
|
| 228 |
-
|gpqa_diamond_zeroshot| 1|none | 0|acc |↑ |0.3824| 0.237 |
|
| 229 |
|
| 230 |
## Model
|
| 231 |
Link to the model
|
|
|
|
| 223 |
|-------|------:|--------------|-----:|-----------|---|-----:|
|
| 224 |
|biology| 1|custom-extract| 5|exact_match|↑ |0.3453|
|
| 225 |
|
| 226 |
+
| Tasks |Version|Filter|n-shot| Metric | |PD-Gemma 3n-E4B | E4B IT| changes |
|
| 227 |
+
|---------------------|------:|------|-----:|--------|---|-----:| -----:| -----:|
|
| 228 |
+
|gpqa_diamond_zeroshot| 1|none | 0|acc |↑ |0.3824| 0.237 | 61.350% increase in gpqa diamond|
|
| 229 |
|
| 230 |
## Model
|
| 231 |
Link to the model
|