Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

36,328

Full-text search

Active filters: bitsandbytes

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.03k • 3

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 224 • 1

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 57 • 11

PrunaAI/Universal-NER-UniNER-7B-all-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7 • 1

GGmorello/FLAMES

Text Generation • Updated Jun 11, 2024 • 11 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 84.5k • 197

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 54.8k • 132

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.08k • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 13 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 36 • 21

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 552 • 42

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • Updated May 2, 2024 • 4 • 1

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 4 • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 302 • 26

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated Apr 28, 2024 • 43 • 1

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 13.7k • 29

unsloth/Yi-1.5-6B-bnb-4bit

Text Generation • Updated May 13, 2024 • 14 • 3

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 105 • 1

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated May 21, 2024 • 16 • 6

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 61.9k • 71

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 25.4k • 16

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.21k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 495 • 28

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 14.8k • 19

weifar/FTAudit-llama3-8b-v1

Text Generation • Updated Sep 16, 2024 • 11 • 2

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 326 • 30

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.73k • 4

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.35k • 5

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.76k • 2

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.76k • 4