Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

1,038

Full-text search

Active filters: vllm

moot20/Mistral-Small-24B-Instruct-2501-MLX-4bit

Text Generation • 4B • Updated Jan 31 • 6

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated 20 days ago • 399 • 5

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • 4B • Updated Mar 30 • 24.2k • 24

matatonic/Mistral-Small-24B-Instruct-2501-4.0bpw-exl2

Text Generation • Updated Jan 30 • 6 • 1

matatonic/Mistral-Small-24B-Instruct-2501-5.0bpw-exl2

Text Generation • Updated Jan 30 • 6 • 1

matatonic/Mistral-Small-24B-Instruct-2501-6.5bpw-h8-exl2

Text Generation • Updated Jan 30 • 4

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q2_K-GGUF

24B • Updated Jan 30 • 2

moot20/Mistral-Small-24B-Base-2501-MLX-4bit

Text Generation • 4B • Updated Jan 30 • 3

RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic

Text Generation • 24B • Updated May 30 • 39.2k • 13

VoidStare/Mistral-Small-24B-Instruct-2501-EXL2-6.5bpw-h8

Text Generation • Updated Jan 30 • 4

jth01/Mistral-Small-24B-Instruct-2501-6.0bpw-h8-exl2

Text Generation • Updated Jan 30 • 8

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • 71B • Updated Feb 1 • 3 • 3

Statuo/MS-24b-Instruct-EXL2-8bpw

Text Generation • Updated Jan 30 • 4

Statuo/MS-24b-Instruct-EXL2-6bpw

Text Generation • Updated Jan 30 • 9

Statuo/MS-24b-Instruct-EXL2-4bpw

Text Generation • Updated Jan 30 • 5

gghfez/Mistral-Small-24B-Instruct-2501

Text Generation • 24B • Updated Feb 22 • 6

gghfez/Mistral-Small-24B-Base-2501

Text Generation • 24B • Updated Jan 30 • 6

CuckmeisterFuller/Mistral-Small-24B-Instruct-2501-4bit-Q2-mlx

4B • Updated Jan 31 • 5

CuckmeisterFuller/Mistral-Small-24B-Instruct-2501-bf16-Q2-mlx

2B • Updated Jan 31 • 5

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_2.5bpw_H8

Text Generation • Updated Jan 31 • 11

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_3.5bpw_H8

Text Generation • Updated Jan 31 • 11

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

Text Generation • Updated Jan 31 • 15 • 1

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_5.0bpw_H8

Updated Jan 31 • 10 • 1

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_5.5bpw_H8

Text Generation • Updated Jan 31 • 15

Jellon/Mistral-Small-24B-Instruct-2501-exl2-6bpw

Text Generation • Updated Jan 31 • 8

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_6bpw_H8

Text Generation • Updated Jan 31 • 10

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_8bpw_H8

Text Generation • Updated Jan 31 • 12

Jellon/Mistral-Small-24B-Instruct-2501-exl2-4bpw

Text Generation • Updated Jan 31 • 4

KnutJaegersberg/Mistral-Small-24B-Instruct-2501-exl2-8.0bpw

Text Generation • Updated Jan 31 • 4

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16

Text Generation • 4B • Updated May 30 • 166