Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,519

Full-text search

Active filters: gptq

RedHatAI/Qwen2-7B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 58

RedHatAI/Llama-2-7b-chat-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 39

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 29, 2024 • 4.06k • 2

RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 192 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 61

RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • Updated Mar 13 • 278 • 2

Xu-Ouyang/pythia-6.9b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 13

Xu-Ouyang/pythia-410m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 11

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 29

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 11

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 9

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 13

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 13

Xu-Ouyang/pythia-6.9b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 16

Xu-Ouyang/pythia-6.9b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 12

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 10

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 32

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 27

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 9

HRuiii/Meta-Llama-3-8B-GPTQ-4bit

Text Generation • Updated Jul 12, 2024 • 10

Xu-Ouyang/pythia-160m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 23

Xu-Ouyang/pythia-160m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 49

Xu-Ouyang/pythia-1b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 12

Xu-Ouyang/pythia-160m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 9

Xu-Ouyang/pythia-160m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 11

Xu-Ouyang/pythia-160m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 10

Xu-Ouyang/pythia-1b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 13, 2024 • 12