"RuntimeError: mat1 and mat2 shapes cannot be multiplied (1x256 and 3072x256)"
#2
by
popeyed
- opened
I'm using a quantized t5 (Q4_K_M) from https://huggingface.co/city96/t5-v1_1-xxl-encoder-gguf/tree/main
It works with dev, schnell, and other finetunes such as shuttle (quantized). But it will not work with chroma-unlocked-v24-Q4_K_M. Is this a known thing?
I can't test the full model since I only have 8GB of VRAM.
@popeyed This isn't Flux anymore. If you are using ComfyUI, go to the main repo for this model for instructions or wait a little for the implementation to ComfyUI core repo