gaianet
/

gemma-2-9b-it-GGUF

Text Generation

Model card Files Files and versions Community

Gemma-2-9b-it-GGUF

Original Model

google/gemma-2-9b-it

Run with Gaianet

Prompt template:

prompt template: gemma-instruct

Context size:

Max

chat_ctx_size: 8192

Recommend

chat_ctx_size: 4096

Run with GaiaNet:

Quick start with Gemma-2-9b-it: https://github.com/GaiaNet-AI/node-configs/blob/main/gemma-2-9b-it/README.md
Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b3259

Downloads last month: 127

GGUF

Model size

9.24B params

Architecture

gemma2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for gaianet/gemma-2-9b-it-GGUF

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Quantized

(146)

this model

Collection including gaianet/gemma-2-9b-it-GGUF

gemma-2

3 items • Updated Feb 10