please release AWQ version

#31
by classdemo - opened

please release AWQ version

Any way to launch a quantized version on vLLM?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment