Vision doesn't work on Ollama
I've imported gguf files including mmproj via "Create"modelfile command on Ollama, but it doesn't seem to recognize the vision feature. (imatrix one doesn't work as well.)
Tested with Page Assist and Msty. vision works fine on Koboldcpp, but I want to make it work on ollama so I can test this model further with other frontend options.
sorry, I'm fairly new to all this. any help?
vision is very quirky right now in terms of support, see this:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha/discussions/2
And for a capable, although pre-beta POC, I'd suggest using this instead:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha
and specifically with the attached instructions:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha#how-to-run-it
I see. thank you for the answers :)