mlx-community/Apriel-1.5-15b-Thinker-3bit-MLX
Image-Text-to-Text
•
Updated
•
47
🍎 MLX-Quantized Models (3/4/5/6-bit) Mac & iOS
Curated MLX-ready quantized LLMs that run fast on Apple Silicon (and some on iOS). Every card lists Bits · Group size · Peak UM (GB) · Stable context.
-
-
mlx-community/Apriel-1.5-15b-Thinker-6bit-MLX
Image-Text-to-Text • Updated • 106 -
mlx-community/granite-4.0-h-tiny-3bit-MLX
Text Generation • 0.9B • Updated • 148 • 2 -
mlx-community/granite-4.0-tiny-preview-4bit
Text Generation • 1B • Updated • 167 -
mlx-community/granite-4.0-h-tiny-5bit-MLX
Text Generation • 1B • Updated • 172 • 1 -
mlx-community/granite-4.0-h-tiny-6bit-MLX
Text Generation • 7B • Updated • 157 -
mlx-community/granite-4.0-h-small-4bit
Text Generation • 32B • Updated • 254 -
mlx-community/Apriel-1.5-15b-Thinker-5bit
Text Generation • Updated • 111