Hugging Face's logo

mradermacher
/
Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF

Transformers
GGUF
English
Merge
programming
code generation
code
coding
coder
chat
brainstorm
qwen
qwen3
qwencoder
brainstorm20x
unsloth
trl
sft
cot
reasoning
thinking
think
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
9fb9ad0
·
verified ·
1 Parent(s): 69f31bc

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +98 -0
README.md CHANGED
@@ -1,6 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  <!-- ### quantize_version: 2 -->
2
  <!-- ### output_tensor_quantised: 1 -->
3
  <!-- ### convert_type: hf -->
4
  <!-- ### vocab_type: -->
5
  <!-- ### tags: nicoboss -->
6
  weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: DavidAU/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x
3
+ datasets:
4
+ - nvidia/OpenCodeReasoning
5
+ - vicgalle/creative-rubrics-gpt-4.5-o3-R1
6
+ language:
7
+ - en
8
+ library_name: transformers
9
+ license: apache-2.0
10
+ mradermacher:
11
+ readme_rev: 1
12
+ quantized_by: mradermacher
13
+ tags:
14
+ - merge
15
+ - programming
16
+ - code generation
17
+ - code
18
+ - coding
19
+ - coder
20
+ - chat
21
+ - code
22
+ - chat
23
+ - brainstorm
24
+ - qwen
25
+ - qwen3
26
+ - qwencoder
27
+ - brainstorm20x
28
+ - unsloth
29
+ - trl
30
+ - sft
31
+ - code
32
+ - coding
33
+ - cot
34
+ - reasoning
35
+ - thinking
36
+ - think
37
+ ---
38
+ ## About
39
+
40
  <!-- ### quantize_version: 2 -->
41
  <!-- ### output_tensor_quantised: 1 -->
42
  <!-- ### convert_type: hf -->
43
  <!-- ### vocab_type: -->
44
  <!-- ### tags: nicoboss -->
45
  weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x
46
+
47
+ <!-- provided-files -->
48
+
49
+ ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF).***
50
+
51
+ static quants are available at https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-GGUF
52
+ ## Usage
53
+
54
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
55
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
56
+ more details, including on how to concatenate multi-part files.
57
+
58
+ ## Provided Quants
59
+
60
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
61
+
62
+ | Link | Type | Size/GB | Notes |
63
+ |:-----|:-----|--------:|:------|
64
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own qwuants) |
65
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ2_M.gguf) | i1-IQ2_M | 2.3 | |
66
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.3 | very low quality |
67
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q2_K.gguf) | i1-Q2_K | 2.5 | IQ3_XXS probably better |
68
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.5 | lower quality |
69
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.7 | |
70
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.8 | IQ3_XS probably better |
71
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ3_S.gguf) | i1-IQ3_S | 2.8 | beats Q3_K* |
72
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ3_M.gguf) | i1-IQ3_M | 2.9 | |
73
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.1 | IQ3_S probably better |
74
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.4 | IQ3_M probably better |
75
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.4 | |
76
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q4_0.gguf) | i1-Q4_0 | 3.6 | fast, low quality |
77
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.6 | prefer IQ4_XS |
78
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q4_K_S.gguf) | i1-Q4_K_S | 3.6 | optimal size/speed/quality |
79
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q4_K_M.gguf) | i1-Q4_K_M | 3.7 | fast, recommended |
80
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q4_1.gguf) | i1-Q4_1 | 3.9 | |
81
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.2 | |
82
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.3 | |
83
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x-i1-GGUF/resolve/main/Qwen3-Code-Reasoning-Instruct-6B-Brainstorm20x.i1-Q6_K.gguf) | i1-Q6_K | 5.0 | practically like static Q6_K |
84
+
85
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
86
+ types (lower is better):
87
+
88
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
89
+
90
+ And here are Artefact2's thoughts on the matter:
91
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
92
+
93
+ ## FAQ / Model Request
94
+
95
+ See https://huggingface.co/mradermacher/model_requests for some answers to
96
+ questions you might have and/or if you want some other model quantized.
97
+
98
+ ## Thanks
99
+
100
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
101
+ me use its servers and providing upgrades to my workstation to enable
102
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
103
+
104
+ <!-- end -->