IntelligentEstate/Tanngrisnir-Qwen3-4B-Q4_K_M-GGUF

A small fast Goat further gnashed from Bunny's 4GB model

gnasher.jpg

This model was converted to GGUF format from bunnycore/Qwen3-4B-Dot-Goat using llama.cpp

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

Downloads last month
0
GGUF
Model size
4.02B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for IntelligentEstate/Tanngrisnir-Qwen3-4B-Q4_K_M-GGUF

Quantized
(3)
this model