allenai
/

OLMo-7B-0424-Instruct-hf

Text Generation

Model card Files Files and versions Community

hamishivi commited on Jul 9, 2024

Commit

e91ee2d

·

verified ·

1 Parent(s): 9690399

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -96,9 +96,9 @@ Core model results for the 7B adapted models are found below.
 | Model                 | MMLU 0-shot ↑ | AlpacaEval %win ↑ | ToxiGen % Toxic ↓ | TruthfulQA %Info+True ↑ |
 |-----------------------|---------------|--------------------|--------------------|-------------------------|
-| **OLMo 1.7 base**      | 50.8          | -                  | 81.4               | 31.6                    |
-| **[OLMo 1.7 7B SFT](https://huggingface.co/allenai/OLMo-1.7-7B-SFT-hf)**         |    54.2       | 70.9               | .1               | 44.4                    |
-| **[OLMo 1.7 7B Instruct](https://huggingface.co/allenai/OLMo-1.7-7B-Instruct-hf)**     | 52.8          | 83.5               | 1.7                | 70.3                    |

 | Model                 | MMLU 0-shot ↑ | AlpacaEval %win ↑ | ToxiGen % Toxic ↓ | TruthfulQA %Info+True ↑ |
 |-----------------------|---------------|--------------------|--------------------|-------------------------|
+| **OLMo 1.7 base**      | 47.5          | -                  | 83.2               | 25.7                    |
+| **[OLMo 1.7 7B SFT](https://huggingface.co/allenai/OLMo-1.7-7B-SFT-hf)**         |    52.4       | 70.4               | 0.5               | 38.8                    |
+| **[OLMo 1.7 7B Instruct](https://huggingface.co/allenai/OLMo-1.7-7B-Instruct-hf)**     | 52.4          | 82.2               | 0.2                | 75.6                    |