Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

28,462

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 5 days ago • 3.46k • 24

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • Updated 4 days ago • 686 • 21

mlx-community/DeepSeek-V3-0324-4bit

Text Generation • Updated 8 days ago • 650 • 29

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 3 days ago • 4.21k • 10

Qwen/QwQ-32B-AWQ

Text Generation • Updated 21 days ago • 209k • 105

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 5 days ago • 2.49k • 6

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 10 days ago • 2.93k • 8

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 81.9k • 100

casperhansen/deepseek-r1-distill-qwen-7b-awq

Updated Feb 8 • 9.59k • 9

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 17 • 130k • 43

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 25 days ago • 27.5k • 37

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • Updated 13 days ago • 1.52k • 14

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.79M • 88

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.62M • 18

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 120k • 26

John6666/llama-joycaption-alpha-two-hf-llava-nf4

Image-Text-to-Text • Updated Jan 29 • 550 • 18

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.23k • 5

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 70.9k • 51

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated Feb 26 • 7.06k • 17

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 3 days ago • 53.9k • 74

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 834k • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 1 day ago • 52.4k • 18

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 286 • 2

mlx-community/watt-tool-8B

Updated Feb 13 • 65 • 4

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 17 • 68.3k • 26

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 25 days ago • 158k • 45

secemp9/TraceBack-12b

Text Generation • Updated 18 days ago • 1.43k • 28

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 26 days ago • 389 • 2

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 23 days ago • 2.4k • 9

unsloth/gemma-3-27b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 19 days ago • 21k • 6