mlx-community/quantized-gemma-2b-it
Text Generation
•
Updated
•
583
•
10
Quantized MLX LLMs
-
-
mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Text Generation • Updated • 8.19k • 16 -
mlx-community/Mistral-Large-Instruct-2407-4bit
Updated • 17.6k • 1 -
mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed
Text Generation • Updated • 83 • 3 -
mlx-community/Dolphin-2.9.3-Mistral-Nemo-12b-4bit
Updated • 9 -
mlx-community/dolphin-2.9.4-gemma2-2b-4bit
Updated • 2 -
mlx-community/zephyr-7b-beta-4bit
Text Generation • Updated • 3 • 1