Jean Louis PRO

Ollama? Takes more VRAM! It requires GGUF files, but they are anyway created by llama.cpp software, it is slower than llama.cpp, using models not published on ollama website requires user to think about it, configure, unlike llama.cpp

No way.

There is nothing to be proud of, you have based it on the proprietary model, disabling people to use it how they wish and want and totally disregarding free software principles. Why don't you take a good example from Microsoft IBM, Mistral or Allen AI, Qwen or DeepSeek companies which are distributing free software models?

Gemma License (danger) is not Free Software and is not Open Source
https://gnu.support/gnu-emacs/emacs-lisp/Gemma-License-danger-is-not-Free-Software-and-is-not-Open-Source.html

The Gemma Terms of Use and Prohibited Use Policy govern the use, modification, and distribution of Google's Gemma machine learning model and its derivatives. While Gemma is available for public use, it does not conform to Free Software or Open Source principles as defined by the Free Software Foundation (FSF) or Open Source Initiative (OSI). The terms impose significant restrictions, including prohibited use cases (e.g., illegal, harmful, or malicious activities), requirements to enforce Google's use restrictions on downstream users, and limitations on redistribution and derived works. Additionally, the terms do not guarantee access to source code or the freedom to use the software for any purpose, and they include broad disclaimers of warranty and liability. As a result, Gemma is a proprietary model with limited permissions, rather than a truly free or open-source software offering.

What is Free Software? - GNU Project - Free Software Foundation
https://www.gnu.org/philosophy/free-sw.html

Totally fantastic, one of the best obviously. I hope it will run on a 30 90, 24 GB GPU.

What is hard when I already gave you the command which works well?