
allenai/OLMoE-1B-7B-0125
Text Generation
β’
Updated
β’
475
β’
13
Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app
Note π§±Base version of OLMoE. Use as foundation for post-training or Fine Tuning.
Note π€ Instruct variant of OLMoE. Use it in chat models
Note π² Quantized version of OLMoE. Great for running locally on device.
Note π1οΈβ£ Pretrain data mix.
Note π2οΈβ£ Mid-train data mix.
Note π3οΈβ£ Post-train SFT data mix.
Note π4οΈβ£ Post-train preference data mix (DPO).
Note SFT only verision of OLMoE. Use allenai/OLMoE-1B-7B-0125-Instruct instead.
Note SFT + DPO only verision of OLMoE. Use allenai/OLMoE-1B-7B-0125-Instruct instead.
Note Quantized version of base model. Use allenai/OLMoE-1B-7B-0125-Instruct-GGUF instead.