Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,749

Full-text search

Active filters: awq

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 4 days ago • 2.68k • 23

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 2 days ago • 3.26k • 10

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 9 days ago • 2.64k • 8

Qwen/QwQ-32B-AWQ

Text Generation • Updated 20 days ago • 205k • 104

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 83.3k • 100

casperhansen/deepseek-r1-distill-qwen-7b-awq

Updated Feb 8 • 9.34k • 9

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 2 days ago • 53.8k • 74

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • Updated 12 days ago • 1.45k • 14

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 98 • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated about 12 hours ago • 49.4k • 18

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 17 • 63.8k • 26

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 24 days ago • 159k • 45

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated 9 days ago • 765 • 3

trillionlabs/Trillion-7B-preview-GGUF

Text Generation • Updated 7 days ago • 851 • 6

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 7.66k • 21

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 67 • 1

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 21 • 13

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 34 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 2.62k • 30

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.37k • 38

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • Updated Nov 9, 2023 • 122 • 18

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 102 • 35

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 804 • 72

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 922 • 36

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 374 • 16

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 335 • 9

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 40 • 2

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 23 • 3

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 166 • 1