leaderboard-pr-bot commited on
Commit
3a59415
1 Parent(s): a48b7c0

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +20 -7
README.md CHANGED
@@ -1,17 +1,17 @@
1
  ---
 
 
 
2
  license: apache-2.0
3
- base_model: Qwen/Qwen2-0.5B
4
  tags:
5
  - axolotl
6
  - generated_from_trainer
 
 
 
7
  model-index:
8
  - name: Qwen2-0.5B-Abyme
9
  results: []
10
- datasets:
11
- - Magpie-Align/Magpie-Qwen2-Pro-300K-Filtered
12
- language:
13
- - en
14
- - zh
15
  ---
16
 
17
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -131,4 +131,17 @@ The following hyperparameters were used during training:
131
  - Transformers 4.42.3
132
  - Pytorch 2.3.1+cu121
133
  - Datasets 2.19.1
134
- - Tokenizers 0.19.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
  license: apache-2.0
 
6
  tags:
7
  - axolotl
8
  - generated_from_trainer
9
+ base_model: Qwen/Qwen2-0.5B
10
+ datasets:
11
+ - Magpie-Align/Magpie-Qwen2-Pro-300K-Filtered
12
  model-index:
13
  - name: Qwen2-0.5B-Abyme
14
  results: []
 
 
 
 
 
15
  ---
16
 
17
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
131
  - Transformers 4.42.3
132
  - Pytorch 2.3.1+cu121
133
  - Datasets 2.19.1
134
+ - Tokenizers 0.19.1
135
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
136
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_CoolSpring__Qwen2-0.5B-Abyme)
137
+
138
+ | Metric |Value|
139
+ |-------------------|----:|
140
+ |Avg. | 4.76|
141
+ |IFEval (0-Shot) |19.15|
142
+ |BBH (3-Shot) | 2.28|
143
+ |MATH Lvl 5 (4-Shot)| 1.51|
144
+ |GPQA (0-shot) | 0.45|
145
+ |MuSR (0-shot) | 1.48|
146
+ |MMLU-PRO (5-shot) | 3.70|
147
+