Hugging Face's logo

kz919
/
llama3_1b_chinchilla_8132025

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Model card Files
xet
Community
kz919 commited on
Commit
f0094e3
·
verified ·
1 Parent(s): 9258c50

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -44,4 +44,13 @@ lm_eval --model hf --model_args pretrained=kz919/llama3_1b_chinchilla_8142025,dt
44
  |openbookqa | 1|none | 0|acc |↑ | 0.2340|± |0.0190|
45
  | | |none | 0|acc_norm |↑ | 0.3500|± |0.0214|
46
  |piqa | 1|none | 0|acc |↑ | 0.6795|± |0.0109|
47
- | | |none | 0|acc_norm |↑ | 0.6774|± |0.0109|
 
 
 
 
 
 
 
 
 
 
44
  |openbookqa | 1|none | 0|acc |↑ | 0.2340|± |0.0190|
45
  | | |none | 0|acc_norm |↑ | 0.3500|± |0.0214|
46
  |piqa | 1|none | 0|acc |↑ | 0.6795|± |0.0109|
47
+ | | |none | 0|acc_norm |↑ | 0.6774|± |0.0109|
48
+
49
+ ## MMLU
50
+ | Groups |Version|Filter|n-shot|Metric| |Value | |Stderr|
51
+ |------------------|------:|------|------|------|---|-----:|---|-----:|
52
+ |mmlu | 2|none | |acc |↑ |0.2529|± |0.0037|
53
+ | - humanities | 2|none | |acc |↑ |0.2459|± |0.0063|
54
+ | - other | 2|none | |acc |↑ |0.2424|± |0.0077|
55
+ | - social sciences| 2|none | |acc |↑ |0.2697|± |0.0080|
56
+ | - stem | 2|none | |acc |↑ |0.2572|± |0.0078|