Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,19 @@ tags:
|
|
| 13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 14 |
|
| 15 |
## Merge Details
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
### Merge Method
|
| 17 |
|
| 18 |
This model was merged using the NuSLERP merge method.
|
|
|
|
| 13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 14 |
|
| 15 |
## Merge Details
|
| 16 |
+
### Benchmarks
|
| 17 |
+
|
| 18 |
+
| Tasks |Version| Filter |n-shot| Metric | |Value | |Stderr|
|
| 19 |
+
|-----------------|-------|----------------|-----:|-----------|---|-----:|---|------|
|
| 20 |
+
|tinyBenchmarks | N/A| | | | | | | |
|
| 21 |
+
| - tinyArc | 0|none | 25|acc_norm |↑ |0.2407|± | N/A|
|
| 22 |
+
| - tinyGSM8k | 0|flexible-extract | 5|exact_match|↑ |0.0055|± | N/A|
|
| 23 |
+
| | |strict-match | 5|exact_match|↑ |0.0055|± | N/A|
|
| 24 |
+
| - tinyHellaswag | 0|none | 10|acc_norm |↑ |0.3322|± | N/A|
|
| 25 |
+
| - tinyMMLU | 0|none | 0|acc_norm |↑ |0.2839|± | N/A|
|
| 26 |
+
| - tinyTruthfulQA| 0|none | 0|acc |↑ | NaN|± | N/A|
|
| 27 |
+
| - tinyWinogrande| 0|none | 5|acc_norm |↑ |0.4491|± | N/A|
|
| 28 |
+
|
| 29 |
### Merge Method
|
| 30 |
|
| 31 |
This model was merged using the NuSLERP merge method.
|