ArtusDev
/

Delta-Vector_Austral-24B-Winton-EXL2

creative-writing

Model card Files Files and versions

EXL2 Quants of Delta-Vector/Austral-24B-Winton

EXL2 quants of Delta-Vector/Austral-24B-Winton using exllamav2 for quantization.

Quants

Quant(Revision)	Bits per Weight	Head Bits
4.0_H6	4.0	6
4.5_H6	4.5	6

Downloading quants with huggingface-cli

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2 --revision "5.0bpw_H6" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503

Finetuned

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Finetuned

LatitudeGames/Harbinger-24B

Finetuned

Delta-Vector/Austral-24B-Base

Finetuned

Delta-Vector/Austral-SFT-KTO

Finetuned

Delta-Vector/Austral-24B-Winton

Quantized

(8)

this model