Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,994

Full-text search

Active filters: awq

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 5 days ago • 16.8k • 49

cognitivecomputations/Qwen3-30B-A3B-AWQ

Text Generation • Updated 10 days ago • 4.65k • 10

Qwen/Qwen3-14B-AWQ

Text Generation • Updated 5 days ago • 9.53k • 20

Orion-zhen/Qwen3-8B-AWQ

Updated 14 days ago • 9.81k • 9

Orion-zhen/Qwen3-32B-AWQ

Updated 14 days ago • 3.27k • 11

Qwen/Qwen3-4B-AWQ

Text Generation • Updated 5 days ago • 3

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 10.3k • 19

cognitivecomputations/Qwen3-235B-A22B-AWQ

Text Generation • Updated 9 days ago • 2.04k • 8

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 162 • 14

TheBloke/Phind-CodeLlama-34B-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 137 • 34

TheBloke/WizardLM-13B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 67 • 2

TheBloke/airoboros-l2-13B-2.2.1-AWQ

Text Generation • Updated Nov 9, 2023 • 18 • 1

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.13k • 31

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.92k • 37

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 150 • 9

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 33 • 61

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 113 • 16

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1, 2024 • 5.11k • 23

taeminlee/KULLM3-awq

Text Generation • Updated Apr 8, 2024 • 40 • 7

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated Sep 3, 2024 • 98.4k • 4

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 296 • 40

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 336k • 67

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 11.7k • 10

kaitchup/Meta-Llama-3.1-8B-Instruct-awq-4bit

Text Generation • Updated Aug 13, 2024 • 60 • 1

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 61.6k • 77

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 226k • 66

peakji/steiner-32b-preview-awq

Updated Oct 21, 2024 • 4 • 4

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 210 • 7

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 595 • 25