Hey @TheBloke will you quantize those?
It appears they are! E.g https://huggingface.co/TheBloke/tulu-2-dpo-70B-GPTQ
· Sign up or log in to comment
