Hugging Face's logo

PowerInfer
/
SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation
GGUF
English
conversational
Model card Files Community
1
BLGS commited on
Commit
b991ec0
·
verified ·
1 Parent(s): 98318ba

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. SmallThinker-4B-A0.6B-Instruct.Q3_K.gguf +3 -0
  3. SmallThinker-4B-A0.6B-Instruct.Q4_K_S.gguf +3 -0
  4. SmallThinker-4B-A0.6B-Instruct.Q5_K.gguf +3 -0
.gitattributes CHANGED
@@ -40,3 +40,6 @@ SmallThinker-4B-A0.6B-Instruct.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
40
  SmallThinker-4B-A0.6B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmallThinker-4B-A0.6B-Instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
42
  SmallThinker-21B-A3B-Instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
40
  SmallThinker-4B-A0.6B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmallThinker-4B-A0.6B-Instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
42
  SmallThinker-21B-A3B-Instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
43
+ SmallThinker-4B-A0.6B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
44
+ SmallThinker-4B-A0.6B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ SmallThinker-4B-A0.6B-Instruct.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
SmallThinker-4B-A0.6B-Instruct.Q3_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93c47555f568f18acb19f873e66a2beddabe82936a4b360b0e9e1c15b55e7155
3
+ size 2118855264
SmallThinker-4B-A0.6B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f75612a1ad02248a1f902082030d04cd26f856237cd104acc43a3cf4b2582526
3
+ size 2491948128
SmallThinker-4B-A0.6B-Instruct.Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:404a36fe70108d4dc43ce5f8c8de01c49e5b63b46bfc2df3bcd186ee7ec2d025
3
+ size 3058105440