can you please share the script you used to quantize it?
is this w8a8 or w8a16?
· Sign up or log in to comment