gemma-3-270m-it GGUF

Recommended way to run this model:

llama-server -hf ggml-org/gemma-3-270m-it-GGUF -c 0 -fa --jinja

Then, access http://localhost:8080

Downloads last month
736
GGUF
Model size
268M params
Architecture
gemma3
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ggml-org/gemma-3-270m-it-GGUF

Quantized
(22)
this model

Collection including ggml-org/gemma-3-270m-it-GGUF