No Vision Layers?
Thanks for this.
Is this only for text? Is vision omitted?
Hi! You can use the mmproj-model-f16.gguf model from here: https://huggingface.co/lmstudio-community/gemma-3-27b-it-GGUF/tree/main. Simply place it together with the gemma-3-27b-it-abliterated.q4_k_m.gguf model. I was able to run it normally in LM Studio, and it can recognize image content.
Thanks! But what if I use Ollama?
Thanks! But what if I use Ollama?
ditto
"""Hi! You can use the mmproj-model-f16.gguf model from here: https://huggingface.co/lmstudio-community/gemma-3-27b-it-GGUF/tree/main. Simply place it together with the gemma-3-27b-it-abliterated.q4_k_m.gguf model. I was able to run it normally in LM Studio, and it can recognize image content.
"""
worked flawlessly in LM studio, thanks. Bit tricky in OLLAMA though.
"""Hi! You can use the mmproj-model-f16.gguf model from here: https://huggingface.co/lmstudio-community/gemma-3-27b-it-GGUF/tree/main. Simply place it together with the gemma-3-27b-it-abliterated.q4_k_m.gguf model. I was able to run it normally in LM Studio, and it can recognize image content.
"""
worked flawlessly in LM studio, thanks. Bit tricky in OLLAMA though.
What did you do??