s1arsky
/

WeirdCompound-v1.6-24b-EXL3

Model card Files Files and versions

Quantized using the default exllamav3 (0.0.6) quantization process.

Original model: FlareRebellion/WeirdCompound-v1.6-24b - refer for more details on the model.
exllamav3: https://github.com/turboderp-org/exllamav3

EXL3 quants available:

5.0bpw, (for other bpw open request in 'community' section)
Go to "Files and versions", then click on "Main" to choose your quant

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for s1arsky/WeirdCompound-v1.6-24b-EXL3

Base model

FlareRebellion/WeirdCompound-v1.6-24b

Quantized

(6)

this model