4bit Instruct Models - a unsloth Collection

unsloth 's Collections

Unsloth Dynamic 2.0 Quants

gpt-oss

Qwen3

Gemma 3

DeepSeek R1 (All Versions)

Llama 4

Phi-4 (All Versions)

Unsloth 4-bit Dynamic Quants

Deepseek V3 (All Versions)

Text-to-Speech (TTS) models

Diffusion + FLUX models

Mistral Small 3 (All Versions)

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QwQ-32B Collection

Vision/multimodal Models

Llama 3.2 Vision

Llama 3.1 Collection

Load 4bit models 4x faster

4bit Instruct Models

4bit Instruct Models

updated Aug 21