Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

28,462

Full-text search

Active filters: 4-bit

unsloth/c4ai-command-a-03-2025-unsloth-bnb-4bit

Text Generation • Updated 18 days ago • 362 • 3

OPEA/gemma-3-27b-it-int4-AutoRound-cpu

Updated 12 days ago • 44 • 2

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated 10 days ago • 878 • 3

infinitestack/tinyllama-sugarcane

Updated 8 days ago • 6 • 3

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech • Updated 7 days ago • 7.8k • 2

circulus/gemma-3-12b-it-gptq

Updated 7 days ago • 84 • 2

unsloth/orpheus-3b-0.1-pretrained-unsloth-bnb-4bit

Text-to-Speech • Updated 5 days ago • 1.84k • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 100 • 219

TheBloke/gpt4-x-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.59k • 318

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.07k • 163

TheBloke/samantha-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 1.3k • 20

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 663 • 577

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 191 • 85

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 20 • 13

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 352 • 176

TheBloke/WizardLM-33B-V1.0-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 59 • 43

TheBloke/airoboros-33B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 57 • 27

TheBloke/WizardLM-13B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 98 • 46

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 130 • 146

TheBloke/Chronos-Hermes-13B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 41 • 39

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 89 • 15

TheBloke/Chronoboros-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 103 • 29

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 168 • 5

TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 690 • 121

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 7.55k • 362

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 8.25k • 261

TheBloke/Luna-AI-Llama2-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 222 • 87

TheBloke/30B-Epsilon-GPTQ

Text Generation • Updated Sep 27, 2023 • 28 • 6

TheBloke/Nous-Hermes-Llama2-GPTQ

Text Generation • Updated Sep 27, 2023 • 828 • 59