EXL2 Quants by FrenzyBiscuit.

This model is 6.0BPW EXL2.

Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_6.0bpw_H8

Base model

Qwen/Qwen2.5-1.5B
Quantized
(8)
this model

Collection including ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_6.0bpw_H8