kurakurai
/

Luth-LFM2-1.2B

Text Generation

Model card Files Files and versions

MaxLSB commited on about 1 month ago

Commit

774ee5f

·

verified ·

1 Parent(s): 44de1a7

Update README.md

Files changed (1) hide show

README.md +14 -14

README.md CHANGED Viewed

@@ -36,25 +36,25 @@ We used LightEval for evaluation, with custom tasks for the French benchmarks. T
 ### French Benchmark Scores
-| Benchmark         | LFM2-1.2B        | Luth-LFM2-1.2B     |
 |-------------------|------------------|-----------------------|
-| ifeval-fr (strict prompt) | 53.60    | <u>60.44</u>          |
-| gpqa-fr           | 25.77            | <u>27.02</u>          |
-| mmlu-fr           | 47.59            | <u>47.98</u>          |
-| math-500-fr       | 35.80            | <u>47.20</u>          |
-| arc-chall-fr      | <u>39.44</u>     |         39.01         |
-| hellaswag-fr      | 33.05            | <u>36.76</u>          |
 ### English Benchmark Scores
-| Benchmark         | LFM2-1.2B        | Luth-LFM2-1.2B     |
 |-------------------|------------------|-----------------------|
-| ifeval-en (strict prompt)| 70.43     | <u>70.61</u>                 |
-| gpqa-en           |     26.68        | <u>28.21</u>          |
-| mmlu-en           | <u>55.18</u>     | 54.59                 |
-| math-500-en       | 44.60            | <u>50.20</u>          |
-| arc-chall-en      | 43.09            | <u>43.26</u>          |
-| hellaswag-en      | 57.64            | <u>58.46</u>          |
 ## Code Example

 ### French Benchmark Scores
+| **Benchmark**         | **LFM2-1.2B**        | **Luth-LFM2-1.2B**     |
 |-------------------|------------------|-----------------------|
+| **IFEval-fr (strict prompt)** | 53.60    | <u>60.44</u>          |
+| **GPQA-fr**           | 25.77            | <u>27.02</u>          |
+| **MMLU-fr**           | 47.59            | <u>47.98</u>          |
+| **MATH-500-fr**       | 35.80            | <u>47.20</u>          |
+| **Arc-Chall-fr**      | <u>39.44</u>     |         39.01         |
+| **Hellaswag-fr**      | 33.05            | <u>36.76</u>          |
 ### English Benchmark Scores
+| **Benchmark**         | **LFM2-1.2B**        | **Luth-LFM2-1.2B**     |
 |-------------------|------------------|-----------------------|
+| **IFEval-en (strict prompt)**| 70.43     | <u>70.61</u>                 |
+| **GPQA-en**           |     26.68        | <u>28.21</u>          |
+| **MMLU-en**           | <u>55.18</u>     | 54.59                 |
+| **MATH-500-en**       | 44.60            | <u>50.20</u>          |
+| **Arc-Chall-en**      | 43.09            | <u>43.26</u>          |
+| **Hellaswag-en**      | 57.64            | <u>58.46</u>          |
 ## Code Example