Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
QwQ-32B-GGUF
like
18
Text Generation
Transformers
GGUF
13 languages
chat
imatrix
conversational
arxiv:
2309.00071
arxiv:
2412.15115
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
2
Train
Deploy
Use this model
8da6e45
QwQ-32B-GGUF
Ctrl+K
Ctrl+K
2 contributors
History:
25 commits
Mungert
Upload QwQ-32B-q4_1.gguf with huggingface_hub
8da6e45
verified
about 1 month ago
f16
Upload f16/QwQ-32B-F16-00002-of-00002.gguf with huggingface_hub
about 1 month ago
.gitattributes
2.9 kB
Upload QwQ-32B-q4_1.gguf with huggingface_hub
about 1 month ago
QwQ-32B-bf16_q4_k.gguf
21.9 GB
xet
Upload QwQ-32B-bf16_q4_k.gguf with huggingface_hub
about 1 month ago
QwQ-32B-bf16_q6_k.gguf
28.7 GB
xet
Upload QwQ-32B-bf16_q6_k.gguf with huggingface_hub
about 1 month ago
QwQ-32B-bf16_q8_0.gguf
36.3 GB
xet
Upload QwQ-32B-bf16_q8_0.gguf with huggingface_hub
about 1 month ago
QwQ-32B-f16_q4_k.gguf
21.9 GB
xet
Upload QwQ-32B-f16_q4_k.gguf with huggingface_hub
about 1 month ago
QwQ-32B-f16_q6_k.gguf
28.7 GB
xet
Upload QwQ-32B-f16_q6_k.gguf with huggingface_hub
about 1 month ago
QwQ-32B-f16_q8_0.gguf
36.3 GB
xet
Upload QwQ-32B-f16_q8_0.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q2_k_l.gguf
13.1 GB
xet
Upload QwQ-32B-q2_k_l.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q2_k_s.gguf
11.7 GB
xet
Upload QwQ-32B-q2_k_s.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q3_k_l.gguf
16.6 GB
xet
Upload QwQ-32B-q3_k_l.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q3_k_m.gguf
16 GB
xet
Upload QwQ-32B-q3_k_m.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q3_k_s.gguf
14.5 GB
xet
Upload QwQ-32B-q3_k_s.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q4_0.gguf
18.4 GB
xet
Upload QwQ-32B-q4_0.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q4_1.gguf
20.5 GB
xet
Upload QwQ-32B-q4_1.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q4_k_l.gguf
20.4 GB
xet
Upload QwQ-32B-q4_k_l.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q4_k_m.gguf
20.1 GB
xet
Upload QwQ-32B-q4_k_m.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q4_k_s.gguf
19 GB
xet
Upload QwQ-32B-q4_k_s.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q5_k_l.gguf
23.7 GB
xet
Upload QwQ-32B-q5_k_l.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q5_k_m.gguf
23.4 GB
xet
Upload QwQ-32B-q5_k_m.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q5_k_s.gguf
22.7 GB
xet
Upload QwQ-32B-q5_k_s.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q6_k_l.gguf
27.3 GB
xet
Upload QwQ-32B-q6_k_l.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q6_k_m.gguf
26.9 GB
xet
Upload QwQ-32B-q6_k_m.gguf with huggingface_hub
about 1 month ago
QwQ-32B-q8_0.gguf
34.8 GB
xet
Upload QwQ-32B-q8_0.gguf with huggingface_hub
about 1 month ago
