can you quantize this https://huggingface.co/syzymon/long_llama_3b_instruct
Yes i do ..It' s in the pipeline right now:)( As well as the v1.1 of this one)
· Sign up or log in to comment
