Quantized qwen 1.7b instruct outputs "!!!!!!!"
#1
by
anrgct
- opened
Hello, thank you for the quantized Qwen instruct, the accuracy is very high. I downloaded several and they were all great, even the 0.6b was impressive, but this one is a bit bad, often outputting things like "!!!!!!!". I wonder if it wasn't quantized properly.