aggie
/

llama-3.2-3B-instruct-GGUF-Q8

Model card Files Files and versions

LLaMA 3.2 3B Instruct - GGUF (Q8_0)

This is the Q8_0 quantized GGUF version of Meta's LLaMA 3.2 3B Instruct model.

Downloads last month: 7

GGUF

Model size

3B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for aggie/llama-3.2-3B-instruct-GGUF-Q8

Base model

meta-llama/Llama-3.2-3B-Instruct

Quantized

(386)

this model