Hugging Face's logo

unsloth
/
Qwen3-4B-GGUF

Text Generation
Transformers
GGUF
English
qwen3
qwen
unsloth
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
58bb0de
·
verified ·
1 Parent(s): e342d53

Add files using upload-large-folder tool

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Qwen3-4B-BF16.gguf +3 -0
  3. Qwen3-4B-Q8_0.gguf +3 -0
  4. imatrix_unsloth.dat +3 -0
.gitattributes CHANGED
@@ -55,3 +55,6 @@ Qwen3-4B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
  Qwen3-4B-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
56
  Qwen3-4B-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
57
  Qwen3-4B-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
55
  Qwen3-4B-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
56
  Qwen3-4B-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
57
  Qwen3-4B-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
58
+ imatrix_unsloth.dat filter=lfs diff=lfs merge=lfs -text
59
+ Qwen3-4B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen3-4B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:294c3456c8e06499e4dec92b59e19ebb38b14d30e518f272e517a65d47155098
3
+ size 8051285056
Qwen3-4B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4802a4755afa05c43beece13b59dff086ff4c155ee7eaff63ca1130dbc02e74b
3
+ size 4280405280
imatrix_unsloth.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02644bdb0806f5f50298521396ff0d35a736f28ce10a8cac3ce3f5897825dc52
3
+ size 3842218