Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,749

Full-text search

Active filters: awq

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 15 • 1

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 1.8k • 4

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024 • 2 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 673 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 73 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 324 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 12 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 257k • 62

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 17.2k • 9

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 81 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 57.6k • 48

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 4.16k • 21

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2, 2024 • 31 • 5

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15, 2024 • 36 • 2

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 9.04k • 49

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 3.96k • 9

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 1.91k • 5

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 15.8k • 9

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 35k • 21

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 48.9k • 19

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 64.2k • 67

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 65.2k • 61

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 5.17k • 12

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 17k • 3

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 28 • 2

nimishbongale/phi-3-mini-128k-instruct-cuda-awq-int4-block-32-gemm

Updated Sep 28, 2024 • 12 • 1

peakji/steiner-32b-preview-awq

Updated Oct 21, 2024 • 11 • 4

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 11.5k • 4

PyrTools/Ministral-8B-Instruct-2410-AWQ

Updated Oct 25, 2024 • 150 • 1

Orion-zhen/aya-expanse-32b-AWQ

Text Generation • Updated Oct 27, 2024 • 1.17k • 4