8.0bpw?
#3
by
svippixel
- opened
Great job! Can you help quantize it to 8.0bpw?
https://huggingface.co/FuturisticVibes/magnum-v2-72b-8.0bpw-h8-exl2
Someone already quanted to 8bpw.
lucyknada
changed discussion status to
closed