Quantized using exllamav3 (0.0.5) quantization process.


EXL3 quants available:

  • 5.0bpw, 3.5bpw (for other bpw open request in 'community' section)
  • Go to "Files and versions", then click on "Main" to choose your quant
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for s1arsky/WeirdCompound-v1.5-24b-EXL3

Quantized
(4)
this model