Models

unsloth/gpt-oss-20b-unsloth-bnb-4bit

Text Generation • 21B • Updated 5 days ago • 28.4k • 10

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 31.7k • 36

Intel/gpt-oss-20b-int4-rtn-AutoRound

2B • Updated 6 days ago • 594 • 8

unsloth/gpt-oss-20b-bnb-4bit

Text Generation • 21B • Updated 7 days ago • 36.5k • 7

openbmb/MiniCPM-V-4-AWQ

Image-Text-to-Text • 1B • Updated 1 day ago • 147 • 9

Intel/gpt-oss-120b-int4-rtn-AutoRound

2B • Updated 7 days ago • 125 • 6

InferenceIllusionist/gpt-oss-20b-MLX-4bit

21B • Updated 7 days ago • 2.08k • 6

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated 5 days ago • 56.7k • 6

Qwen/Qwen3-32B-AWQ

Text Generation • 6B • Updated May 21 • 723k • 98

QuantTrio/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 33B • Updated 16 days ago • 657 • 6

Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound

2B • Updated 16 days ago • 638 • 8

dousery/medical-reasoning-gpt-oss-20b

Text Generation • 21B • Updated 2 days ago • 102 • 5

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit-dwq-v2

Text Generation • 31B • Updated 4 days ago • 465 • 5

QuantTrio/GLM-4.5V-AWQ

Image-Text-to-Text • 17B • Updated about 21 hours ago • 5

mlx-community/Qwen3-4B-Instruct-2507-4bit

Text Generation • 0.6B • Updated 7 days ago • 781 • 4

QuantTrio/GLM-4.5-Air-GPTQ-Int4-Int8Mix

Text Generation • 20B • Updated 14 days ago • 3.18k • 9

tencent/Hunyuan-7B-Instruct-GPTQ-Int4

Text Generation • 1B • Updated 7 days ago • 190 • 5

Intel/gpt-oss-20b-int4-AutoRound

2B • Updated 6 days ago • 4.08k • 3

helizac/dots.ocr-4bit

Image-to-Text • 2B • Updated 6 days ago • 165 • 3

baichuan-inc/Baichuan-M2-32B-GPTQ-Int4

Text Generation • 6B • Updated 2 days ago • 153 • 3

akashcsd/Llama3_project_management_assistant

Text Generation • Updated Jul 1, 2024 • 48 • 3

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 3B • Updated Apr 6 • 340k • 83

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • 3B • Updated Apr 6 • 2.39k • 16

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • 6B • Updated Apr 6 • 5.33k • 28

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • 20B • Updated May 12 • 6.12k • 14

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • 0.4B • Updated Jun 23 • 41k • 15

Qwen/Qwen3-14B-AWQ

Text Generation • 3B • Updated May 21 • 97.6k • 29

Qwen/Qwen3-8B-AWQ

Text Generation • 2B • Updated May 21 • 37.6k • 18

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 29.1k • 22

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 12.7k • 22