awq quant
#1
by
prudant
- opened
are you going to do an awq version? it can be done?
regards, and awesome job! =)
Hello, thank you for your interest. You can use lmdeploy to work with the InternVL 2.5 MPO series AWQ models.
See here: https://huggingface.co/OpenGVLab/InternVL2_5-8B-MPO-AWQ
czczup
changed discussion status to
closed