Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

566

Full-text search

Active filters: vllm

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 9 days ago • 105k • 1.02k

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 1 day ago • 3 • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 1 day ago • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 1 day ago • 30

mistralai/Mistral-Small-3.1-24B-Base-2503

Updated 11 days ago • 17.3k • 181

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 145k • 464

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • Updated 18 days ago • 8.93k • 89

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 12 days ago • 20k • 17

mistralai/Mistral-Small-24B-Base-2501

Text Generation • Updated Jan 30 • 24.2k • 239

mistralai/Mistral-Small-24B-Instruct-2501

Text Generation • Updated Feb 2 • 352k • • 886

NousResearch/DeepHermes-3-Mistral-24B-Preview-GGUF

Updated 18 days ago • 3.17k • 23

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • Updated 11 days ago • 31.1k • 12

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • Updated 11 days ago • 1.19k • 7

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 5.22k • 385

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 4.2k • 212

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 33 • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated about 10 hours ago • 49.4k • 18

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated 18 days ago • 56.9k • 302

unsloth/Mistral-Small-3.1-24B-Instruct-2503

Updated 12 days ago • 923 • 8

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 12.2k • 23

neuralmagic/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 12.6k • 7

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 537 • 14

neuralmagic/Qwen2-0.5B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 7.06k • 3

neuralmagic/gemma-2-9b-it-FP8

Text Generation • Updated Jul 18, 2024 • 700 • 6

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 54.9k • 40

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 4.54k • 6

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated 5 days ago • 350k • 42

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated Oct 23, 2024 • 11.1k • 10

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 32.5k • 14

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 7.06k • 825