l3utterfly
/

Llama-3.2-3B-Instruct-gguf

Model card Files Files and versions

Llama-3.2-3B-Instruct-gguf

23.6 GB

1 contributor

History: 3 commits

l3utterfly's picture

Add quantised GGUF files

f8abc49 9 months ago

.gitattributes

1.56 kB

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q2_K.gguf

1.36 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q4_0.gguf

1.92 GB
xet

Add quantised GGUF files 9 months ago
Llama-3.2-3B-Instruct-Q4_0_4_4.gguf

1.92 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q4_0_4_8.gguf

1.92 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q4_0_8_8.gguf

1.92 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q4_K_M.gguf

2.02 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q6_K.gguf

2.64 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-Q8_0.gguf

3.42 GB
xet

Add quantised GGUF files 10 months ago
Llama-3.2-3B-Instruct-f16.gguf

6.43 GB
xet

Add quantised GGUF files 10 months ago
README.md

29 Bytes

initial commit 10 months ago