Fp8 Quants please

#3
by rjmehta - opened

Thanks for this model. Would like fp8 quants to run on low resource gpus

Sign up or log in to comment