Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,537

Full-text search

Active filters: gptq

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4, 2024 • 42 • 17

AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 168 • 6

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

AI-Sweden-Models/gpt-sw3-20b-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 128 • 4

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 368k • 136

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 15k • 51

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 200 • 111

TheBloke/GEITje-7B-chat-GPTQ

Text Generation • Updated Dec 19, 2023 • 41 • 4

TheBloke/laser-dolphin-mixtral-2x7b-dpo-GPTQ

Text Generation • Updated Jan 15, 2024 • 58 • 11

TheBloke/DareVox-7B-GPTQ

Text Generation • Updated Jan 17, 2024 • 20 • 2

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31, 2024 • 626 • 57

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 66 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.05k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 166 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 98 • 26

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 218 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 67 • 5

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 126 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 34 • 2

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 71 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 54 • 13

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 158 • 4

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • Updated Jun 9, 2024 • 345 • 44

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 1.87k • 30

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8, 2024 • 12

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.17k • 25

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 31 • 17

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated Feb 12 • 474 • 2

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.31k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 30 • 5