Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
EXL2 quants by FrenzyBiscuit
This model is 5.5 BPW EXL2
- Downloads last month
- 9
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ReadyArt/Cydonia-24B-v2.1_EXL2_5.5bpw_H8
Base model
TheDrummer/Cydonia-24B-v2.1