eaddario
/

DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation

Model card Files Files and versions

DeepSeek-R1-Distill-Llama-8B-GGUF

109 GB

1 contributor

History: 38 commits

eaddario's picture

Experimental quantize+prune IQ3_S

2cb0145 verified 7 months ago

imatrix
Generate Small imatrix 9 months ago
logits
Generate base model logits 9 months ago
scores
Generate perplexity and kld scores 9 months ago
.gitattributes

1.65 kB

Update .gitattributes 9 months ago
.gitignore

6.78 kB

Add .gitignore 9 months ago
DeepSeek-R1-Distill-Llama-8B-F16.gguf

16.1 GB
xet

Convert to GGUF @ F16 9 months ago
DeepSeek-R1-Distill-Llama-8B-IQ3_M.gguf

3.78 GB
xet

Generate IQ3_M quant 9 months ago
DeepSeek-R1-Distill-Llama-8B-IQ3_S.gguf

3.37 GB
xet

Experimental quantize+prune IQ3_S 7 months ago
DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf

4.35 GB
xet

Experimental quantize+prune IQ4_NL 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_L.gguf

4.01 GB
xet

Experimental quantize+prune Q3_K_L 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_M.gguf

3.71 GB
xet

Experimental quantize+prune Q3_K_M 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf

3.35 GB
xet

Experimental quantize+prune Q3_K_S 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf

4.59 GB
xet

Experimental quantize+prune Q4_K_M 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_S.gguf

4.36 GB
xet

Experimental quantize+prune Q4_K_S 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_M.gguf

5.34 GB
xet

Experimental quantize+prune Q5_K_M 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_S.gguf

5.21 GB
xet

Experimental quantize+prune Q5_K_S 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q6_K.gguf

6.13 GB
xet

Experimental quantize+prune Q6_K 7 months ago
DeepSeek-R1-Distill-Llama-8B-Q8_0.gguf

7.82 GB
xet

Experimental quantize+prune Q8_0 7 months ago
README.md

9.71 kB

Update README.md 8 months ago