Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

566

Full-text search

Active filters: vllm

neuralmagic/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • Updated Jan 25 • 41 • 1

neuralmagic/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • Updated about 1 month ago • 177 • 1

NeoChen1024/Ministral-8B-Instruct-2410-W8A8

Updated Jan 17 • 29 • 1

neuralmagic/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated Jan 22 • 4.61k • 5

enferAI/DeepSeek-R1-Distill-Qwen-14B-FP8

Text Generation • Updated Jan 21 • 145 • 2

adriabama06/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-8bit

Text Generation • Updated Jan 22 • 156 • 1

mlx-community/Mistral-Small-24B-Instruct-2501-bf16

Updated Jan 30 • 600 • 6

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated Jan 30 • 950 • 11

mlx-community/Mistral-Small-24B-Instruct-2501-3bit

Updated Jan 30 • 73 • 2

mlx-community/Mistral-Small-24B-Instruct-2501-8bit

Updated Jan 30 • 261 • 3

adamo1139/Mistral-Small-24B-Instruct-2501-ungated

Updated Jan 30 • 40 • 1

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Jan 30 • 8 • 2

adamo1139/Mistral-Small-24B-Base-2501-ungated

Updated Jan 30 • 24 • 1

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

Updated Jan 30 • 6 • 1

Hasso5703/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

Updated Jan 30 • 187 • 2

Hasso5703/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Jan 30 • 10 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

Updated Jan 30 • 12 • 1

lolnoyarite/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated Jan 30 • 54 • 1

IntervitensInc/Mistral-Small-24B-Instruct-2501-chatml

Text Generation • Updated Feb 2 • 118 • 1

matatonic/Mistral-Small-24B-Instruct-2501-5.0bpw-exl2

Text Generation • Updated Jan 30 • 38 • 1

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 1 • 235 • 3

Almawave/Velvet-14B

Text Generation • Updated Feb 20 • 5.04k • 132

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_5.0bpw_H8

Updated Jan 31 • 13 • 1

neuralmagic/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • Updated Jan 31 • 32 • 1

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated Jan 31 • 7 • 1

huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

Text Generation • Updated Feb 2 • 1.7k • 15

neuralmagic/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

Text Generation • Updated Feb 27 • 288 • 2

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic

Text Generation • Updated Feb 27 • 420 • 1

neuralmagic/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • Updated Feb 27 • 949 • 3

neuralmagic/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic

Text Generation • Updated Feb 27 • 1.57k • 6