Hugging Face's logo

MaziyarPanahi
/
QwQ-32B-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
4a17a39
·
verified ·
1 Parent(s): a36066e

[WIP] Upload folder using huggingface_hub (multi-commit 98ff2ed1cf390ae57a5f75cf27c851285edc407fda358bf5de8fb8d25325c39a) (#1)

Browse files

- dfc0c102486f76b267aaa827419acd66084296ccdd78d21bf2578f37daba1bae (44c748b55a5e3c0e984683cf0cab278e06c62e7e)
- b1da26cf3873499822c81049c2f5aceb5af379cb1a61e69feca428b384436e22 (bd39e8177b9e7b77302bac5db663115672cb44c0)
- d416173657bdea7787070f59a129bda071783f961d9d4d9fdd30d74f7ec504c8 (1a230446c96fe87d4b676dde84972057eff9adcb)
- 37e7f6af09978bc0cb4e785f04fab63bd0964d9ba363aabb9d4af4a45fe7d57b (bcbe86b540ee9a5a0673a936f9b12d7a87fdaf7d)
- 7c6fe89ceab5d1e219f2a422597cefa02792799e0baf520fd47d583989e7191e (d6da01d35b6d51f446d583ca5962f9d732e2d618)
- 2a296afc9025599adb5a3002123ff27b167566f03f95fda91c231cbb85b3b3fb (0da85318e9c6c42fef070c23d43a5c6b67585b1b)
- 2a559a02fc4f185fcedaac8ff596ce68765eca681773ac1b940360a9d28c53cd (139e8ae6363304126cd7547dbf588c6029127670)

Files changed (8) hide show
  1. .gitattributes +7 -0
  2. QwQ-32B.Q2_K.gguf +3 -0
  3. QwQ-32B.Q3_K_L.gguf +3 -0
  4. QwQ-32B.Q3_K_M.gguf +3 -0
  5. QwQ-32B.Q3_K_S.gguf +3 -0
  6. QwQ-32B.Q4_K_M.gguf +3 -0
  7. QwQ-32B.Q4_K_S.gguf +3 -0
  8. QwQ-32B.Q5_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ QwQ-32B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ QwQ-32B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ QwQ-32B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ QwQ-32B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ QwQ-32B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ QwQ-32B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ QwQ-32B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
QwQ-32B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f4715a1a39e6f6127b30e371a97f545b42d4ba5cc01739ac69395f5a14e1f7d
3
+ size 12313707552
QwQ-32B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69f514021d82cd7780e66c7c55e6905424494715731b539b65a323b09f9aba9f
3
+ size 17247687712
QwQ-32B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:052024e951e1251e53ba8e71ff5597a6a31fc125a51eeeec5262b5b4f976f299
3
+ size 15935656992
QwQ-32B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35386e8c1943d7078c76f0f7617762adc4c5ff50f003e871e5b39d0add75c557
3
+ size 14392939552
QwQ-32B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec4b3d17087af8d8414c1de85269d5fbc396277a99d949f75ca42ff52e7d09d4
3
+ size 19851944992
QwQ-32B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9ff315297335bdca9cd0c2bdbcecb1b0cc88f58ac4b5450bf1c7da46f62012e
3
+ size 18785018912
QwQ-32B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d6d4d69cc099c50a5dd0f4a1235e0733b3b48ae9e53b6c749c580b9865860d9
3
+ size 23262766112