Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

DavidAU
/
Mistral-Small-3.1-24B-Instruct-2503-MAX-NEO-Imatrix-GGUF

Text Generation
GGUF
Mistral
Mistral 2503
instruct
128k context
all use cases
maxed quants
Neo Imatrix
imatrix
conversational
Model card Files Files and versions Community
7
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Other Mistral Small based models?

2
#7 opened 3 months ago by
MrDevolver

error with most recent vLLM

3
#6 opened 3 months ago by
elbiot

IQ4_NL vs IQ4_XS vs Q4_K_S vs Q4_0

2
#5 opened 3 months ago by
CosmossG

Recommendations

1
#4 opened 3 months ago by
Adzeiros

I'm curious how did you convert it to GGUF ?

1
#3 opened 3 months ago by
prayanksai

Health check error?

2
#2 opened 3 months ago by
nobeardbugs

Amazing on old hardware

2
#1 opened 3 months ago by
nobeardbugs
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs