Sinensis
/

MS3.2-24B-Magnum-Diamond-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

FP8-Dynamic (llmcompressor oneshot) quant of Doctor-Shotgun/MS3.2-24B-Magnum-Diamond

Downloads last month: 5

Safetensors

Model size

23.6B params

Tensor type

BF16

·

F8_E4M3

·

Model tree for Sinensis/MS3.2-24B-Magnum-Diamond-FP8-Dynamic

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503

Finetuned

mistralai/Mistral-Small-3.2-24B-Instruct-2506

Finetuned

Doctor-Shotgun/MS3.2-24B-Magnum-Diamond

Quantized

(6)

this model