Hugging Face's logo

ZeroAgency
/
Zero-Mistral-Small-24B-Instruct-2501-BF16

Text Generation
GGUF
Transformers
English
Russian
vllm
mistral
chat
conversational
Inference Endpoints
Model card Files Community
bethrezen commited on
Commit
d4e5ebb
·
1 Parent(s): 7da62c6

add - [Q4_K_M GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-Q4_K_M)

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -30,3 +30,4 @@ The training involved SFT stage on [GrandMaster-PRO-MAX](https://huggingface.co/
30
  - [F16 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-F16)
31
  - [BF16 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-BF16)
32
  - [Q8_0 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-Q8_0)
 
 
30
  - [F16 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-F16)
31
  - [BF16 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-BF16)
32
  - [Q8_0 GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-Q8_0)
33
+ - [Q4_K_M GGUF](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501-Q4_K_M)