Update README.md (#11)
Browse files- Update README.md (81edf170938c14db5b638b8b876924c69aea5fe2)
README.md
CHANGED
|
@@ -230,6 +230,23 @@ All GGUF models are available here: [MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-G
|
|
| 230 |
# 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 231 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__Phi-3-mini-4k-instruct-v0.3)
|
| 232 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 233 |
| Metric |Value|
|
| 234 |
|---------------------------------|----:|
|
| 235 |
|Avg. |70.26|
|
|
@@ -241,6 +258,7 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
|
|
| 241 |
|GSM8k (5-shot) |74.53|
|
| 242 |
|
| 243 |
|
|
|
|
| 244 |
`MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3` is the best-performing Phi-3-mini-4k model on the Open LLM Leaderboard. (03/06/2024).
|
| 245 |
|
| 246 |

|
|
@@ -319,17 +337,3 @@ print(output[0]['generated_text'])
|
|
| 319 |
|
| 320 |
|
| 321 |
```
|
| 322 |
-
|
| 323 |
-
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
| 324 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__Phi-3-mini-4k-instruct-v0.3)
|
| 325 |
-
|
| 326 |
-
| Metric |Value|
|
| 327 |
-
|-------------------|----:|
|
| 328 |
-
|Avg. |23.38|
|
| 329 |
-
|IFEval (0-Shot) |49.26|
|
| 330 |
-
|BBH (3-Shot) |37.66|
|
| 331 |
-
|MATH Lvl 5 (4-Shot)| 2.95|
|
| 332 |
-
|GPQA (0-shot) | 9.06|
|
| 333 |
-
|MuSR (0-shot) | 7.75|
|
| 334 |
-
|MMLU-PRO (5-shot) |31.42|
|
| 335 |
-
|
|
|
|
| 230 |
# 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 231 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__Phi-3-mini-4k-instruct-v0.3)
|
| 232 |
|
| 233 |
+
|
| 234 |
+
|
| 235 |
+
** Leaderboard 2**
|
| 236 |
+
|
| 237 |
+
| Metric |Value|
|
| 238 |
+
|-------------------|----:|
|
| 239 |
+
|Avg. |23.38|
|
| 240 |
+
|IFEval (0-Shot) |49.26|
|
| 241 |
+
|BBH (3-Shot) |37.66|
|
| 242 |
+
|MATH Lvl 5 (4-Shot)| 2.95|
|
| 243 |
+
|GPQA (0-shot) | 9.06|
|
| 244 |
+
|MuSR (0-shot) | 7.75|
|
| 245 |
+
|MMLU-PRO (5-shot) |31.42|
|
| 246 |
+
|
| 247 |
+
|
| 248 |
+
** Leaderboard 1**
|
| 249 |
+
|
| 250 |
| Metric |Value|
|
| 251 |
|---------------------------------|----:|
|
| 252 |
|Avg. |70.26|
|
|
|
|
| 258 |
|GSM8k (5-shot) |74.53|
|
| 259 |
|
| 260 |
|
| 261 |
+
|
| 262 |
`MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3` is the best-performing Phi-3-mini-4k model on the Open LLM Leaderboard. (03/06/2024).
|
| 263 |
|
| 264 |

|
|
|
|
| 337 |
|
| 338 |
|
| 339 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|