https://huggingface.co/huihui-ai/Qwen2.5-VL-32B-Instruct-abliterated
#823
by
SerialKicked
- opened
Hey, could you do this one?
I'm surprised that nobody did this one, or even its base model from Qwen already. Is there a particular reason why? (just curious)
In any case, thank you!
It's actually in the queue for a day, but note that 2.5 is not fully supported by llama.cpp, so no vision part yet. I've bumped it's priority - you can check for progress at http://hf.tst.eu/status.html
mradermacher
changed discussion status to
closed
Thanks you! Yeah I know. But KoboldCPP does support it .
no, koboldcpp has zero support for transformers models - koboldcpp simply uses a stripped down, older version of llama.cpp. it can't do anything without llama.cpp support for this model (and converting it first).