Vision doesn't work on Ollama

#1
by Floatie9 - opened

I've imported gguf files including mmproj via "Create"modelfile command on Ollama, but it doesn't seem to recognize the vision feature. (imatrix one doesn't work as well.)

Tested with Page Assist and Msty. vision works fine on Koboldcpp, but I want to make it work on ollama so I can test this model further with other frontend options.

sorry, I'm fairly new to all this. any help?

Sicarius-Prototyping org

vision is very quirky right now in terms of support, see this:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha/discussions/2

And for a capable, although pre-beta POC, I'd suggest using this instead:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha

and specifically with the attached instructions:
https://huggingface.co/SicariusSicariiStuff/X-Ray_Alpha#how-to-run-it

SicariusSicariiStuff changed discussion status to closed

I see. thank you for the answers :)

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment