Could you please make a GGUF node in Comfyui that makes all quants of GGUF?

#4
by Winnougan - opened

I'd love for you to develop a GGUF node that turns a safetensor into multiple quants all at once from Q2 to Q8. I've tried your other method in Windows, but with no luck. Hopefully you'll one day make this node so I could make multiple quants all at once for one safetensor. Thanks Calcuis. I love your hard work man.

Sign up or log in to comment