Models

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 31.6k • 36

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 27.4k • 22

tencent/Hunyuan-7B-Instruct-GPTQ-Int4

Text Generation • 1B • Updated 5 days ago • 180 • 4

baichuan-inc/Baichuan-M2-32B-GPTQ-Int4

Text Generation • 6B • Updated about 4 hours ago • 1 • 3

btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit

Text Generation • 5B • Updated 10 days ago • 1.27k • 3

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 5.62k • 212

Qwen/Qwen-7B-Chat-Int4

Text Generation • 2B • Updated Jan 4, 2024 • 1.74k • 75

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • 2B • Updated Jan 26, 2024 • 45 • 18

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • 3B • Updated Apr 30 • 1.7k • 3

Qwen/Qwen3-1.7B-GPTQ-Int8

Text Generation • 0.7B • Updated May 21 • 1.96k • 3

Qwen/Qwen3-0.6B-GPTQ-Int8

Text Generation • 0.3B • Updated May 21 • 3.18k • 8

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 12.6k • 21

iqbalamo93/Phi-4-mini-instruct-GPTQ-8bit

Text Generation • 1B • Updated May 20 • 126k • 1

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10 • 408 • 1

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 11B • Updated Jul 11 • 146k • 47

jart25/Qwen3-30B-A3B-Thinking-2507-Autoround-Int-4bit-gptq

0.6B • Updated 11 days ago • 21 • 1

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated 10 days ago • 736 • 1

Dinith132/first_lora

Updated 4 days ago • 1

TheBloke/Loyal-Macaroni-Maid-7B-GPTQ

Text Generation • 1B • Updated Dec 24, 2023 • 80 • 13

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 18 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 17 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 61 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 22 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 18 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 17 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 21 • 45

TheBloke/koala-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 48 • 31

TheBloke/koala-7B-HF

Text Generation • Updated Jun 5, 2023 • 2.04k • 21

TheBloke/koala-13B-HF

Text Generation • Updated Jun 5, 2023 • 2.21k • 41

TheBloke/koala-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 21 • 38