not marked as vision in LM Studio
#1
by
phazei
- opened
For whatever reason this isn't marked as vision capable in LM studio.
This one you did is though:
https://model.lmstudio.ai/download/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-GGUF
This repository is indeed missing the mmproj files containing the vision stack. Thanks a lot for letting us know. They will be generated shortly and if everything goes well should appear within the next hour after which the vision capabilities of this model can be used.
The mmproj files of this model are now available. This model should now be correctly detected as vision model.
- Vision stack in Q8: https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Instruct-abliterated-GGUF/blob/main/Qwen2.5-VL-7B-Instruct-abliterated.mmproj-Q8_0.gguf
- Vision stack in F16: https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Instruct-abliterated-GGUF/blob/main/Qwen2.5-VL-7B-Instruct-abliterated.mmproj-f16.gguf