DeathGodlike
/

Rei-24B-KTO_H8-4.0BPW_EXL3

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Original model: Rei-24B-KTO by Delta-Vector

EXL3 quant of the model.

Head bits: 8 | Weight bits: 4

Downloads last month: 15

Safetensors

Model size

6.57B params

Tensor type

F16

·

I16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DeathGodlike/Rei-24B-KTO_H8-4.0BPW_EXL3

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503

Finetuned

mistralai/Mistral-Small-3.2-24B-Instruct-2506

Finetuned

zerofata/MS3.2-PaintedFantasy-24B

Finetuned

Delta-Vector/Rei-24B-Base

Finetuned

Delta-Vector/Rei-24B-KTO

Quantized

(7)

this model