Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,621

Full-text search

Active filters: awq

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated 6 days ago • 4.71k • 9

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 19.8k • 32

FractalGPT/RuQwen2.5-3B-Instruct-AWQ

Text Generation • Updated 3 days ago • 220 • 4

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 25.3k • 39

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 249k • 89

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 260k • 39

WisPerMed/Llama-3.1-SauerkrautLM-70b-Instruct-AWQ

Text Generation • Updated 25 days ago • 190 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 105 • 1

TheBloke/llama2_70b_chat_uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 37 • 6

TheBloke/Pygmalion-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 83 • 5

TheBloke/Phind-CodeLlama-34B-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 1.19k • 32

TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 85 • 13

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 97 • 13

TheBloke/WizardLM-7B-uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 40 • 4

TheBloke/LLaMA-65B-AWQ

Text Generation • Updated Nov 9, 2023 • 16 • 2

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 245k • 37

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 224 • 33

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 852 • 38

TheBloke/MetaMath-Mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 102 • 1

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 1.28k • 71

TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 68.4k • 21

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 23.5k • 8

TheBloke/goliath-120b-AWQ

Text Generation • Updated Nov 9, 2023 • 130 • 11

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 207 • 8

jamesdborin/llama2-13b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 28 • 1

TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 14, 2023 • 771 • 58

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 394 • 15

casperhansen/mixtral-instruct-awq

Text Generation • Updated Feb 11 • 10.3k • 43

TheBloke/Nous-Hermes-2-Yi-34B-AWQ

Text Generation • Updated Dec 26, 2023 • 63 • 8

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1 • 1.65k • 21