MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
Paper
•
2402.14905
•
Published
•
131
MobileLLM
Optimizing Sub-billion Parameter Language Models for On-Device Use Cases (ICML 2024) https://arxiv.org/abs/2402.14905
-
-
facebook/MobileLLM-125M
Text Generation • Updated • 3.61k • 116 -
facebook/MobileLLM-350M
Text Generation • Updated • 180 • 35 -
facebook/MobileLLM-600M
Text Generation • Updated • 1.46k • 29 -
facebook/MobileLLM-1B
Text Generation • Updated • 208 • 121 -
facebook/MobileLLM-1.5B
Text Generation • Updated • 68 • 11 -
facebook/MobileLLM-125M-layer-share
Text Generation • Updated • 134 • 8 -
facebook/MobileLLM-350M-layer-share
Text Generation • Updated • 191 • 7 -
ParetoQ: Scaling Laws in Extremely Low-bit LLM Quantization
Paper • 2502.02631 • Published • 4 -
facebook/MobileLLM-ParetoQ-125M-BF16
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-125M-1-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-125M-1.58-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-125M-2-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-125M-3-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-125M-4-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-BF16
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-1-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-1.58-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-2-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-3-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-350M-4-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-600M-BF16
Text Generation • Updated • 2 • 7 -
facebook/MobileLLM-ParetoQ-600M-1-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-600M-1.58-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-600M-2-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-600M-3-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-600M-4-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-1B-BF16
Text Generation • Updated • 1 -
facebook/MobileLLM-ParetoQ-1B-1-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-1B-1.58-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-1B-2-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-1B-3-bit
Text Generation • Updated • 4 -
facebook/MobileLLM-ParetoQ-1B-4-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-1.5B-BF16
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-1.5B-1-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-1.5B-1.58-bit
Text Generation • Updated -
facebook/MobileLLM-ParetoQ-1.5B-2-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-1.5B-3-bit
Text Generation • Updated • 2 -
facebook/MobileLLM-ParetoQ-1.5B-4-bit
Text Generation • Updated • 2