Hugging Face's logo

unsloth
/
Qwen3-4B-GGUF

Text Generation
Transformers
GGUF
English
qwen3
qwen
unsloth
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
caa01ab
·
verified ·
1 Parent(s): 75d698a

Add files using upload-large-folder tool

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Qwen3-4B-Q2_K.gguf +3 -0
  3. Qwen3-4B-Q3_K_M.gguf +3 -0
  4. Qwen3-4B-Q4_K_M.gguf +3 -0
  5. Qwen3-4B-Q6_K.gguf +3 -0
  6. Qwen3-4B-UD-IQ2_XXS.gguf +3 -0
  7. Qwen3-4B-UD-Q3_K_XL.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,9 @@ Qwen3-4B-UD-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Qwen3-4B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
  Qwen3-4B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
41
  Qwen3-4B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
39
  Qwen3-4B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
  Qwen3-4B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
41
  Qwen3-4B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3-4B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3-4B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3-4B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3-4B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3-4B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen3-4B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b29c0f69533bdc4a5b2f9c343ed287600a03ddbcd6ac80ee8d7fe3e94130812
3
+ size 1669499680
Qwen3-4B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43d7aa90340479c1c83b7e992af489240389d00544da6f7dacea884d7def3a5d
3
+ size 2075618080
Qwen3-4B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c129e72a7576bfff7c5f6b59be49990396cffd527baaee825b12f942705a297
3
+ size 2497280800
Qwen3-4B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e18a545c10c388e07acdfb0533f63eeb9a9edbebf29ccd1e50f4e62f9dc35c0
3
+ size 3306261280
Qwen3-4B-UD-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ade29d74dedd132825b073ad0d928e3e5f0311163d9e4568844fb90e8a08fe4c
3
+ size 1255345440
Qwen3-4B-UD-Q3_K_XL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28b42ae2dbfb0d2d106f723bf13f3aa129dd26b3831992ede9f9bd72cd066034
3
+ size 2128384800