Hugging Face's logo

unsloth
/
DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation
Transformers
GGUF
English
llama
deepseek
unsloth
llama-3
meta
conversational
Model card Files
xet
Community
7
danielhanchen commited on
Commit
092e272
·
verified ·
1 Parent(s): 29c2925

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +5 -0
  2. DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf +3 -0
  3. DeepSeek-R1-Distill-Llama-8B-IQ4_XS.gguf +3 -0
  4. DeepSeek-R1-Distill-Llama-8B-Q2_K_L.gguf +2 -2
  5. DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf +3 -0
  6. DeepSeek-R1-Distill-Llama-8B-Q4_0.gguf +3 -0
  7. DeepSeek-R1-Distill-Llama-8B-Q4_1.gguf +3 -0
.gitattributes CHANGED
@@ -49,3 +49,8 @@ DeepSeek-R1-Distill-Llama-8B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
49
  DeepSeek-R1-Distill-Llama-8B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
50
  DeepSeek-R1-Distill-Llama-8B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
51
  DeepSeek-R1-Distill-Llama-8B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
49
  DeepSeek-R1-Distill-Llama-8B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
50
  DeepSeek-R1-Distill-Llama-8B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
51
  DeepSeek-R1-Distill-Llama-8B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
52
+ DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
53
+ DeepSeek-R1-Distill-Llama-8B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
54
+ DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ DeepSeek-R1-Distill-Llama-8B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
56
+ DeepSeek-R1-Distill-Llama-8B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6849a4a8deacbc4ea215c7e70370536e30c82ce53cc209107d7ea06cbe2db29
3
+ size 4677991872
DeepSeek-R1-Distill-Llama-8B-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df6473076371976320dc13339fed94e1532c84ef3b3f4b2eeaf0fe0f19ed7376
3
+ size 4464082368
DeepSeek-R1-Distill-Llama-8B-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0a19db63860697552e32c747ab3cca6d79df0caa037fbbfcaffc821dc6ffcb0
3
- size 3302259424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd619fc424ef209425bb55901c2bfb0f5ca07d0c8ab618d9fff522b2faf94f8e
3
+ size 3302260160
DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af9cc4e9443dabe2e50491f28349e235afb7eaf826348c503378b19e068dad5f
3
+ size 3664502208
DeepSeek-R1-Distill-Llama-8B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b041b222221e8e37d6faffe7b8184392a239c18c2d9a22e89e485b9a5a321e0
3
+ size 4675894720
DeepSeek-R1-Distill-Llama-8B-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a99db150a33c0525b76281ac01123ade90a834a2f027ec9b3ad08ee139d01d9
3
+ size 5130255808