Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

36,328

Full-text search

Active filters: bitsandbytes

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 9.28k • 3

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.46k • 7

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 258 • 2

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 36 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 30 • 2

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22, 2024 • 168 • 4

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.16k • 4

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 1.28k • 34

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated about 1 month ago • 42 • 1

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.07k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.21k • 16

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.91k • 15

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 199 • 6

datatab/Yugo55A-4bit

Text Generation • Updated Oct 1, 2024 • 18 • 1

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 77 • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 941 • 175

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 317 • 14

Sahi19/Gemma2bLegalChatbot

Text Generation • Updated Mar 25, 2024 • 1

Anant58/Genshin-chat-ARM

Text Generation • Updated Dec 13, 2024 • 56 • 1

mlabonne/Jambatypus-v0.1

Text Generation • Updated Apr 4, 2024 • 42 • 39

Severian/Jamba-Hercules

Text Generation • Updated Apr 30, 2024 • 24 • 13

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 17 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 743 • 253

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 39 • 1

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 19 • 1

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.1k • 5

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 109 • 3

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 47 • 1

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 370 • 3

unsloth/codegemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 167 • 1