Hugging Face's logo

nightmedia
/
Qwen3-Instruct-F16-6B-Brainstorm20x-q8-mlx

Text Generation
MLX
Safetensors
English
qwen3
Merge
programming
code generation
code
coding
coder
chat
brainstorm
qwen
qwencoder
brainstorm20x
conversational
Model card Files Community
nightmedia commited on
Commit
2bd1280
·
verified ·
1 Parent(s): e9e4c31

Add files using upload-large-folder tool

Browse files
Files changed (6) hide show
  1. README.md +3 -3
  2. config.json +0 -1338
  3. model-00001-of-00003.safetensors +3 -0
  4. model-00002-of-00003.safetensors +3 -0
  5. model-00003-of-00003.safetensors +3 -0
  6. model.safetensors.index.json +0 -0
README.md CHANGED
@@ -21,9 +21,9 @@ tags:
21
  library_name: mlx
22
  ---
23
 
24
- # Qwen3-Instruct-F16-6B-Brainstorm20x-dq68-mlx
25
 
26
- This model [Qwen3-Instruct-F16-6B-Brainstorm20x-dq68-mlx](https://huggingface.co/Qwen3-Instruct-F16-6B-Brainstorm20x-dq68-mlx) was
27
  converted to MLX format from [DavidAU/Qwen3-Instruct-F16-6B-Brainstorm20x](https://huggingface.co/DavidAU/Qwen3-Instruct-F16-6B-Brainstorm20x)
28
  using mlx-lm version **0.26.0**.
29
 
@@ -36,7 +36,7 @@ pip install mlx-lm
36
  ```python
37
  from mlx_lm import load, generate
38
 
39
- model, tokenizer = load("Qwen3-Instruct-F16-6B-Brainstorm20x-dq68-mlx")
40
 
41
  prompt = "hello"
42
 
 
21
  library_name: mlx
22
  ---
23
 
24
+ # Qwen3-Instruct-F16-6B-Brainstorm20x-q8-mlx
25
 
26
+ This model [Qwen3-Instruct-F16-6B-Brainstorm20x-q8-mlx](https://huggingface.co/Qwen3-Instruct-F16-6B-Brainstorm20x-q8-mlx) was
27
  converted to MLX format from [DavidAU/Qwen3-Instruct-F16-6B-Brainstorm20x](https://huggingface.co/DavidAU/Qwen3-Instruct-F16-6B-Brainstorm20x)
28
  using mlx-lm version **0.26.0**.
29
 
 
36
  ```python
37
  from mlx_lm import load, generate
38
 
39
+ model, tokenizer = load("Qwen3-Instruct-F16-6B-Brainstorm20x-q8-mlx")
40
 
41
  prompt = "hello"
42
 
config.json CHANGED
@@ -17,1344 +17,6 @@
17
  "num_attention_heads": 32,
18
  "num_hidden_layers": 55,
19
  "num_key_value_heads": 8,
20
- "quantization": {
21
- "group_size": 32,
22
- "bits": 6,
23
- "model.embed_tokens": true,
24
- "model.layers.0.self_attn.q_proj": true,
25
- "model.layers.0.self_attn.k_proj": true,
26
- "model.layers.0.self_attn.v_proj": true,
27
- "model.layers.0.self_attn.o_proj": true,
28
- "model.layers.0.self_attn.q_norm": false,
29
- "model.layers.0.self_attn.k_norm": false,
30
- "model.layers.0.self_attn.rope": false,
31
- "model.layers.0.mlp.gate_proj": true,
32
- "model.layers.0.mlp.down_proj": true,
33
- "model.layers.0.mlp.up_proj": true,
34
- "model.layers.0.input_layernorm": false,
35
- "model.layers.0.post_attention_layernorm": false,
36
- "model.layers.1.self_attn.q_proj": true,
37
- "model.layers.1.self_attn.k_proj": true,
38
- "model.layers.1.self_attn.v_proj": true,
39
- "model.layers.1.self_attn.o_proj": true,
40
- "model.layers.1.self_attn.q_norm": false,
41
- "model.layers.1.self_attn.k_norm": false,
42
- "model.layers.1.self_attn.rope": false,
43
- "model.layers.1.mlp.gate_proj": true,
44
- "model.layers.1.mlp.down_proj": true,
45
- "model.layers.1.mlp.up_proj": true,
46
- "model.layers.1.input_layernorm": false,
47
- "model.layers.1.post_attention_layernorm": false,
48
- "model.layers.2.self_attn.q_proj": true,
49
- "model.layers.2.self_attn.k_proj": true,
50
- "model.layers.2.self_attn.v_proj": true,
51
- "model.layers.2.self_attn.o_proj": true,
52
- "model.layers.2.self_attn.q_norm": false,
53
- "model.layers.2.self_attn.k_norm": false,
54
- "model.layers.2.self_attn.rope": false,
55
- "model.layers.2.mlp.gate_proj": true,
56
- "model.layers.2.mlp.down_proj": true,
57
- "model.layers.2.mlp.up_proj": true,
58
- "model.layers.2.input_layernorm": false,
59
- "model.layers.2.post_attention_layernorm": false,
60
- "model.layers.3.self_attn.q_proj": true,
61
- "model.layers.3.self_attn.k_proj": true,
62
- "model.layers.3.self_attn.v_proj": true,
63
- "model.layers.3.self_attn.o_proj": true,
64
- "model.layers.3.self_attn.q_norm": false,
65
- "model.layers.3.self_attn.k_norm": false,
66
- "model.layers.3.self_attn.rope": false,
67
- "model.layers.3.mlp.gate_proj": true,
68
- "model.layers.3.mlp.down_proj": true,
69
- "model.layers.3.mlp.up_proj": true,
70
- "model.layers.3.input_layernorm": false,
71
- "model.layers.3.post_attention_layernorm": false,
72
- "model.layers.4.self_attn.q_proj": true,
73
- "model.layers.4.self_attn.k_proj": true,
74
- "model.layers.4.self_attn.v_proj": true,
75
- "model.layers.4.self_attn.o_proj": true,
76
- "model.layers.4.self_attn.q_norm": false,
77
- "model.layers.4.self_attn.k_norm": false,
78
- "model.layers.4.self_attn.rope": false,
79
- "model.layers.4.mlp.gate_proj": true,
80
- "model.layers.4.mlp.down_proj": true,
81
- "model.layers.4.mlp.up_proj": true,
82
- "model.layers.4.input_layernorm": false,
83
- "model.layers.4.post_attention_layernorm": false,
84
- "model.layers.5.self_attn.q_proj": true,
85
- "model.layers.5.self_attn.k_proj": true,
86
- "model.layers.5.self_attn.v_proj": true,
87
- "model.layers.5.self_attn.o_proj": true,
88
- "model.layers.5.self_attn.q_norm": false,
89
- "model.layers.5.self_attn.k_norm": false,
90
- "model.layers.5.self_attn.rope": false,
91
- "model.layers.5.mlp.gate_proj": true,
92
- "model.layers.5.mlp.down_proj": true,
93
- "model.layers.5.mlp.up_proj": true,
94
- "model.layers.5.input_layernorm": false,
95
- "model.layers.5.post_attention_layernorm": false,
96
- "model.layers.6.self_attn.q_proj": true,
97
- "model.layers.6.self_attn.k_proj": true,
98
- "model.layers.6.self_attn.v_proj": true,
99
- "model.layers.6.self_attn.o_proj": true,
100
- "model.layers.6.self_attn.q_norm": false,
101
- "model.layers.6.self_attn.k_norm": false,
102
- "model.layers.6.self_attn.rope": false,
103
- "model.layers.6.mlp.gate_proj": true,
104
- "model.layers.6.mlp.down_proj": true,
105
- "model.layers.6.mlp.up_proj": true,
106
- "model.layers.6.input_layernorm": false,
107
- "model.layers.6.post_attention_layernorm": false,
108
- "model.layers.7.self_attn.q_proj": true,
109
- "model.layers.7.self_attn.k_proj": true,
110
- "model.layers.7.self_attn.v_proj": true,
111
- "model.layers.7.self_attn.o_proj": true,
112
- "model.layers.7.self_attn.q_norm": false,
113
- "model.layers.7.self_attn.k_norm": false,
114
- "model.layers.7.self_attn.rope": false,
115
- "model.layers.7.mlp.gate_proj": true,
116
- "model.layers.7.mlp.down_proj": true,
117
- "model.layers.7.mlp.up_proj": true,
118
- "model.layers.7.input_layernorm": false,
119
- "model.layers.7.post_attention_layernorm": false,
120
- "model.layers.8.self_attn.q_proj": true,
121
- "model.layers.8.self_attn.k_proj": true,
122
- "model.layers.8.self_attn.v_proj": true,
123
- "model.layers.8.self_attn.o_proj": true,
124
- "model.layers.8.self_attn.q_norm": false,
125
- "model.layers.8.self_attn.k_norm": false,
126
- "model.layers.8.self_attn.rope": false,
127
- "model.layers.8.mlp.gate_proj": true,
128
- "model.layers.8.mlp.down_proj": true,
129
- "model.layers.8.mlp.up_proj": true,
130
- "model.layers.8.input_layernorm": false,
131
- "model.layers.8.post_attention_layernorm": false,
132
- "model.layers.9.self_attn.q_proj": true,
133
- "model.layers.9.self_attn.k_proj": true,
134
- "model.layers.9.self_attn.v_proj": true,
135
- "model.layers.9.self_attn.o_proj": true,
136
- "model.layers.9.self_attn.q_norm": false,
137
- "model.layers.9.self_attn.k_norm": false,
138
- "model.layers.9.self_attn.rope": false,
139
- "model.layers.9.mlp.gate_proj": true,
140
- "model.layers.9.mlp.down_proj": true,
141
- "model.layers.9.mlp.up_proj": true,
142
- "model.layers.9.input_layernorm": false,
143
- "model.layers.9.post_attention_layernorm": false,
144
- "model.layers.10.self_attn.q_proj": true,
145
- "model.layers.10.self_attn.k_proj": true,
146
- "model.layers.10.self_attn.v_proj": true,
147
- "model.layers.10.self_attn.o_proj": true,
148
- "model.layers.10.self_attn.q_norm": false,
149
- "model.layers.10.self_attn.k_norm": false,
150
- "model.layers.10.self_attn.rope": false,
151
- "model.layers.10.mlp.gate_proj": true,
152
- "model.layers.10.mlp.down_proj": true,
153
- "model.layers.10.mlp.up_proj": true,
154
- "model.layers.10.input_layernorm": false,
155
- "model.layers.10.post_attention_layernorm": false,
156
- "model.layers.11.self_attn.q_proj": true,
157
- "model.layers.11.self_attn.k_proj": true,
158
- "model.layers.11.self_attn.v_proj": true,
159
- "model.layers.11.self_attn.o_proj": true,
160
- "model.layers.11.self_attn.q_norm": false,
161
- "model.layers.11.self_attn.k_norm": false,
162
- "model.layers.11.self_attn.rope": false,
163
- "model.layers.11.mlp.gate_proj": true,
164
- "model.layers.11.mlp.down_proj": true,
165
- "model.layers.11.mlp.up_proj": true,
166
- "model.layers.11.input_layernorm": false,
167
- "model.layers.11.post_attention_layernorm": false,
168
- "model.layers.12.self_attn.q_proj": true,
169
- "model.layers.12.self_attn.k_proj": true,
170
- "model.layers.12.self_attn.v_proj": true,
171
- "model.layers.12.self_attn.o_proj": true,
172
- "model.layers.12.self_attn.q_norm": false,
173
- "model.layers.12.self_attn.k_norm": false,
174
- "model.layers.12.self_attn.rope": false,
175
- "model.layers.12.mlp.gate_proj": true,
176
- "model.layers.12.mlp.down_proj": true,
177
- "model.layers.12.mlp.up_proj": true,
178
- "model.layers.12.input_layernorm": false,
179
- "model.layers.12.post_attention_layernorm": false,
180
- "model.layers.13.self_attn.q_proj": true,
181
- "model.layers.13.self_attn.k_proj": true,
182
- "model.layers.13.self_attn.v_proj": true,
183
- "model.layers.13.self_attn.o_proj": true,
184
- "model.layers.13.self_attn.q_norm": false,
185
- "model.layers.13.self_attn.k_norm": false,
186
- "model.layers.13.self_attn.rope": false,
187
- "model.layers.13.mlp.gate_proj": true,
188
- "model.layers.13.mlp.down_proj": true,
189
- "model.layers.13.mlp.up_proj": true,
190
- "model.layers.13.input_layernorm": false,
191
- "model.layers.13.post_attention_layernorm": false,
192
- "model.layers.14.self_attn.q_proj": true,
193
- "model.layers.14.self_attn.k_proj": true,
194
- "model.layers.14.self_attn.v_proj": true,
195
- "model.layers.14.self_attn.o_proj": true,
196
- "model.layers.14.self_attn.q_norm": false,
197
- "model.layers.14.self_attn.k_norm": false,
198
- "model.layers.14.self_attn.rope": false,
199
- "model.layers.14.mlp.gate_proj": true,
200
- "model.layers.14.mlp.down_proj": true,
201
- "model.layers.14.mlp.up_proj": true,
202
- "model.layers.14.input_layernorm": false,
203
- "model.layers.14.post_attention_layernorm": false,
204
- "model.layers.15.self_attn.q_proj": true,
205
- "model.layers.15.self_attn.k_proj": true,
206
- "model.layers.15.self_attn.v_proj": true,
207
- "model.layers.15.self_attn.o_proj": true,
208
- "model.layers.15.self_attn.q_norm": false,
209
- "model.layers.15.self_attn.k_norm": false,
210
- "model.layers.15.self_attn.rope": false,
211
- "model.layers.15.mlp.gate_proj": true,
212
- "model.layers.15.mlp.down_proj": true,
213
- "model.layers.15.mlp.up_proj": true,
214
- "model.layers.15.input_layernorm": false,
215
- "model.layers.15.post_attention_layernorm": false,
216
- "model.layers.16.self_attn.q_proj": true,
217
- "model.layers.16.self_attn.k_proj": true,
218
- "model.layers.16.self_attn.v_proj": true,
219
- "model.layers.16.self_attn.o_proj": true,
220
- "model.layers.16.self_attn.q_norm": false,
221
- "model.layers.16.self_attn.k_norm": false,
222
- "model.layers.16.self_attn.rope": false,
223
- "model.layers.16.mlp.gate_proj": true,
224
- "model.layers.16.mlp.down_proj": {
225
- "bits": 8,
226
- "group_size": 32
227
- },
228
- "model.layers.16.mlp.up_proj": true,
229
- "model.layers.16.input_layernorm": false,
230
- "model.layers.16.post_attention_layernorm": false,
231
- "model.layers.17.self_attn.q_proj": true,
232
- "model.layers.17.self_attn.k_proj": true,
233
- "model.layers.17.self_attn.v_proj": true,
234
- "model.layers.17.self_attn.o_proj": true,
235
- "model.layers.17.self_attn.q_norm": false,
236
- "model.layers.17.self_attn.k_norm": false,
237
- "model.layers.17.self_attn.rope": false,
238
- "model.layers.17.mlp.gate_proj": true,
239
- "model.layers.17.mlp.down_proj": true,
240
- "model.layers.17.mlp.up_proj": true,
241
- "model.layers.17.input_layernorm": false,
242
- "model.layers.17.post_attention_layernorm": false,
243
- "model.layers.18.self_attn.q_proj": true,
244
- "model.layers.18.self_attn.k_proj": true,
245
- "model.layers.18.self_attn.v_proj": true,
246
- "model.layers.18.self_attn.o_proj": true,
247
- "model.layers.18.self_attn.q_norm": false,
248
- "model.layers.18.self_attn.k_norm": false,
249
- "model.layers.18.self_attn.rope": false,
250
- "model.layers.18.mlp.gate_proj": true,
251
- "model.layers.18.mlp.down_proj": true,
252
- "model.layers.18.mlp.up_proj": true,
253
- "model.layers.18.input_layernorm": false,
254
- "model.layers.18.post_attention_layernorm": false,
255
- "model.layers.19.self_attn.q_proj": true,
256
- "model.layers.19.self_attn.k_proj": true,
257
- "model.layers.19.self_attn.v_proj": true,
258
- "model.layers.19.self_attn.o_proj": true,
259
- "model.layers.19.self_attn.q_norm": false,
260
- "model.layers.19.self_attn.k_norm": false,
261
- "model.layers.19.self_attn.rope": false,
262
- "model.layers.19.mlp.gate_proj": true,
263
- "model.layers.19.mlp.down_proj": true,
264
- "model.layers.19.mlp.up_proj": true,
265
- "model.layers.19.input_layernorm": false,
266
- "model.layers.19.post_attention_layernorm": false,
267
- "model.layers.20.self_attn.q_proj": true,
268
- "model.layers.20.self_attn.k_proj": true,
269
- "model.layers.20.self_attn.v_proj": true,
270
- "model.layers.20.self_attn.o_proj": true,
271
- "model.layers.20.self_attn.q_norm": false,
272
- "model.layers.20.self_attn.k_norm": false,
273
- "model.layers.20.self_attn.rope": false,
274
- "model.layers.20.mlp.gate_proj": true,
275
- "model.layers.20.mlp.down_proj": true,
276
- "model.layers.20.mlp.up_proj": true,
277
- "model.layers.20.input_layernorm": false,
278
- "model.layers.20.post_attention_layernorm": false,
279
- "model.layers.21.self_attn.q_proj": true,
280
- "model.layers.21.self_attn.k_proj": true,
281
- "model.layers.21.self_attn.v_proj": true,
282
- "model.layers.21.self_attn.o_proj": true,
283
- "model.layers.21.self_attn.q_norm": false,
284
- "model.layers.21.self_attn.k_norm": false,
285
- "model.layers.21.self_attn.rope": false,
286
- "model.layers.21.mlp.gate_proj": true,
287
- "model.layers.21.mlp.down_proj": true,
288
- "model.layers.21.mlp.up_proj": true,
289
- "model.layers.21.input_layernorm": false,
290
- "model.layers.21.post_attention_layernorm": false,
291
- "model.layers.22.self_attn.q_proj": true,
292
- "model.layers.22.self_attn.k_proj": true,
293
- "model.layers.22.self_attn.v_proj": true,
294
- "model.layers.22.self_attn.o_proj": true,
295
- "model.layers.22.self_attn.q_norm": false,
296
- "model.layers.22.self_attn.k_norm": false,
297
- "model.layers.22.self_attn.rope": false,
298
- "model.layers.22.mlp.gate_proj": true,
299
- "model.layers.22.mlp.down_proj": true,
300
- "model.layers.22.mlp.up_proj": true,
301
- "model.layers.22.input_layernorm": false,
302
- "model.layers.22.post_attention_layernorm": false,
303
- "model.layers.23.self_attn.q_proj": true,
304
- "model.layers.23.self_attn.k_proj": true,
305
- "model.layers.23.self_attn.v_proj": true,
306
- "model.layers.23.self_attn.o_proj": true,
307
- "model.layers.23.self_attn.q_norm": false,
308
- "model.layers.23.self_attn.k_norm": false,
309
- "model.layers.23.self_attn.rope": false,
310
- "model.layers.23.mlp.gate_proj": true,
311
- "model.layers.23.mlp.down_proj": true,
312
- "model.layers.23.mlp.up_proj": true,
313
- "model.layers.23.input_layernorm": false,
314
- "model.layers.23.post_attention_layernorm": false,
315
- "model.layers.24.self_attn.q_proj": true,
316
- "model.layers.24.self_attn.k_proj": true,
317
- "model.layers.24.self_attn.v_proj": true,
318
- "model.layers.24.self_attn.o_proj": true,
319
- "model.layers.24.self_attn.q_norm": false,
320
- "model.layers.24.self_attn.k_norm": false,
321
- "model.layers.24.self_attn.rope": false,
322
- "model.layers.24.mlp.gate_proj": true,
323
- "model.layers.24.mlp.down_proj": true,
324
- "model.layers.24.mlp.up_proj": true,
325
- "model.layers.24.input_layernorm": false,
326
- "model.layers.24.post_attention_layernorm": false,
327
- "model.layers.25.self_attn.q_proj": true,
328
- "model.layers.25.self_attn.k_proj": true,
329
- "model.layers.25.self_attn.v_proj": true,
330
- "model.layers.25.self_attn.o_proj": true,
331
- "model.layers.25.self_attn.q_norm": false,
332
- "model.layers.25.self_attn.k_norm": false,
333
- "model.layers.25.self_attn.rope": false,
334
- "model.layers.25.mlp.gate_proj": true,
335
- "model.layers.25.mlp.down_proj": true,
336
- "model.layers.25.mlp.up_proj": true,
337
- "model.layers.25.input_layernorm": false,
338
- "model.layers.25.post_attention_layernorm": false,
339
- "model.layers.26.self_attn.q_proj": true,
340
- "model.layers.26.self_attn.k_proj": true,
341
- "model.layers.26.self_attn.v_proj": true,
342
- "model.layers.26.self_attn.o_proj": true,
343
- "model.layers.26.self_attn.q_norm": false,
344
- "model.layers.26.self_attn.k_norm": false,
345
- "model.layers.26.self_attn.rope": false,
346
- "model.layers.26.mlp.gate_proj": true,
347
- "model.layers.26.mlp.down_proj": true,
348
- "model.layers.26.mlp.up_proj": true,
349
- "model.layers.26.input_layernorm": false,
350
- "model.layers.26.post_attention_layernorm": false,
351
- "model.layers.27.self_attn.q_proj": true,
352
- "model.layers.27.self_attn.k_proj": true,
353
- "model.layers.27.self_attn.v_proj": true,
354
- "model.layers.27.self_attn.o_proj": true,
355
- "model.layers.27.self_attn.q_norm": false,
356
- "model.layers.27.self_attn.k_norm": false,
357
- "model.layers.27.self_attn.rope": false,
358
- "model.layers.27.mlp.gate_proj": true,
359
- "model.layers.27.mlp.down_proj": true,
360
- "model.layers.27.mlp.up_proj": true,
361
- "model.layers.27.input_layernorm": false,
362
- "model.layers.27.post_attention_layernorm": false,
363
- "model.layers.28.self_attn.q_proj": true,
364
- "model.layers.28.self_attn.k_proj": true,
365
- "model.layers.28.self_attn.v_proj": true,
366
- "model.layers.28.self_attn.o_proj": true,
367
- "model.layers.28.self_attn.q_norm": false,
368
- "model.layers.28.self_attn.k_norm": false,
369
- "model.layers.28.self_attn.rope": false,
370
- "model.layers.28.mlp.gate_proj": true,
371
- "model.layers.28.mlp.down_proj": true,
372
- "model.layers.28.mlp.up_proj": true,
373
- "model.layers.28.input_layernorm": false,
374
- "model.layers.28.post_attention_layernorm": false,
375
- "model.layers.29.self_attn.q_proj": true,
376
- "model.layers.29.self_attn.k_proj": true,
377
- "model.layers.29.self_attn.v_proj": true,
378
- "model.layers.29.self_attn.o_proj": true,
379
- "model.layers.29.self_attn.q_norm": false,
380
- "model.layers.29.self_attn.k_norm": false,
381
- "model.layers.29.self_attn.rope": false,
382
- "model.layers.29.mlp.gate_proj": true,
383
- "model.layers.29.mlp.down_proj": true,
384
- "model.layers.29.mlp.up_proj": true,
385
- "model.layers.29.input_layernorm": false,
386
- "model.layers.29.post_attention_layernorm": false,
387
- "model.layers.30.self_attn.q_proj": true,
388
- "model.layers.30.self_attn.k_proj": true,
389
- "model.layers.30.self_attn.v_proj": true,
390
- "model.layers.30.self_attn.o_proj": true,
391
- "model.layers.30.self_attn.q_norm": false,
392
- "model.layers.30.self_attn.k_norm": false,
393
- "model.layers.30.self_attn.rope": false,
394
- "model.layers.30.mlp.gate_proj": true,
395
- "model.layers.30.mlp.down_proj": true,
396
- "model.layers.30.mlp.up_proj": true,
397
- "model.layers.30.input_layernorm": false,
398
- "model.layers.30.post_attention_layernorm": false,
399
- "model.layers.31.self_attn.q_proj": true,
400
- "model.layers.31.self_attn.k_proj": true,
401
- "model.layers.31.self_attn.v_proj": true,
402
- "model.layers.31.self_attn.o_proj": true,
403
- "model.layers.31.self_attn.q_norm": false,
404
- "model.layers.31.self_attn.k_norm": false,
405
- "model.layers.31.self_attn.rope": false,
406
- "model.layers.31.mlp.gate_proj": true,
407
- "model.layers.31.mlp.down_proj": true,
408
- "model.layers.31.mlp.up_proj": true,
409
- "model.layers.31.input_layernorm": false,
410
- "model.layers.31.post_attention_layernorm": false,
411
- "model.layers.32.self_attn.q_proj": true,
412
- "model.layers.32.self_attn.k_proj": true,
413
- "model.layers.32.self_attn.v_proj": true,
414
- "model.layers.32.self_attn.o_proj": true,
415
- "model.layers.32.self_attn.q_norm": false,
416
- "model.layers.32.self_attn.k_norm": false,
417
- "model.layers.32.self_attn.rope": false,
418
- "model.layers.32.mlp.gate_proj": true,
419
- "model.layers.32.mlp.down_proj": true,
420
- "model.layers.32.mlp.up_proj": true,
421
- "model.layers.32.input_layernorm": false,
422
- "model.layers.32.post_attention_layernorm": false,
423
- "model.layers.33.self_attn.q_proj": true,
424
- "model.layers.33.self_attn.k_proj": true,
425
- "model.layers.33.self_attn.v_proj": true,
426
- "model.layers.33.self_attn.o_proj": true,
427
- "model.layers.33.self_attn.q_norm": false,
428
- "model.layers.33.self_attn.k_norm": false,
429
- "model.layers.33.self_attn.rope": false,
430
- "model.layers.33.mlp.gate_proj": true,
431
- "model.layers.33.mlp.down_proj": true,
432
- "model.layers.33.mlp.up_proj": true,
433
- "model.layers.33.input_layernorm": false,
434
- "model.layers.33.post_attention_layernorm": false,
435
- "model.layers.34.self_attn.q_proj": true,
436
- "model.layers.34.self_attn.k_proj": true,
437
- "model.layers.34.self_attn.v_proj": true,
438
- "model.layers.34.self_attn.o_proj": true,
439
- "model.layers.34.self_attn.q_norm": false,
440
- "model.layers.34.self_attn.k_norm": false,
441
- "model.layers.34.self_attn.rope": false,
442
- "model.layers.34.mlp.gate_proj": true,
443
- "model.layers.34.mlp.down_proj": true,
444
- "model.layers.34.mlp.up_proj": true,
445
- "model.layers.34.input_layernorm": false,
446
- "model.layers.34.post_attention_layernorm": false,
447
- "model.layers.35.self_attn.q_proj": true,
448
- "model.layers.35.self_attn.k_proj": true,
449
- "model.layers.35.self_attn.v_proj": true,
450
- "model.layers.35.self_attn.o_proj": true,
451
- "model.layers.35.self_attn.q_norm": false,
452
- "model.layers.35.self_attn.k_norm": false,
453
- "model.layers.35.self_attn.rope": false,
454
- "model.layers.35.mlp.gate_proj": true,
455
- "model.layers.35.mlp.down_proj": true,
456
- "model.layers.35.mlp.up_proj": true,
457
- "model.layers.35.input_layernorm": false,
458
- "model.layers.35.post_attention_layernorm": false,
459
- "model.layers.36.self_attn.q_proj": true,
460
- "model.layers.36.self_attn.k_proj": true,
461
- "model.layers.36.self_attn.v_proj": true,
462
- "model.layers.36.self_attn.o_proj": true,
463
- "model.layers.36.self_attn.q_norm": false,
464
- "model.layers.36.self_attn.k_norm": false,
465
- "model.layers.36.self_attn.rope": false,
466
- "model.layers.36.mlp.gate_proj": true,
467
- "model.layers.36.mlp.down_proj": true,
468
- "model.layers.36.mlp.up_proj": true,
469
- "model.layers.36.input_layernorm": false,
470
- "model.layers.36.post_attention_layernorm": false,
471
- "model.layers.37.self_attn.q_proj": true,
472
- "model.layers.37.self_attn.k_proj": true,
473
- "model.layers.37.self_attn.v_proj": true,
474
- "model.layers.37.self_attn.o_proj": true,
475
- "model.layers.37.self_attn.q_norm": false,
476
- "model.layers.37.self_attn.k_norm": false,
477
- "model.layers.37.self_attn.rope": false,
478
- "model.layers.37.mlp.gate_proj": true,
479
- "model.layers.37.mlp.down_proj": true,
480
- "model.layers.37.mlp.up_proj": true,
481
- "model.layers.37.input_layernorm": false,
482
- "model.layers.37.post_attention_layernorm": false,
483
- "model.layers.38.self_attn.q_proj": true,
484
- "model.layers.38.self_attn.k_proj": true,
485
- "model.layers.38.self_attn.v_proj": true,
486
- "model.layers.38.self_attn.o_proj": true,
487
- "model.layers.38.self_attn.q_norm": false,
488
- "model.layers.38.self_attn.k_norm": false,
489
- "model.layers.38.self_attn.rope": false,
490
- "model.layers.38.mlp.gate_proj": true,
491
- "model.layers.38.mlp.down_proj": true,
492
- "model.layers.38.mlp.up_proj": true,
493
- "model.layers.38.input_layernorm": false,
494
- "model.layers.38.post_attention_layernorm": false,
495
- "model.layers.39.self_attn.q_proj": true,
496
- "model.layers.39.self_attn.k_proj": true,
497
- "model.layers.39.self_attn.v_proj": true,
498
- "model.layers.39.self_attn.o_proj": true,
499
- "model.layers.39.self_attn.q_norm": false,
500
- "model.layers.39.self_attn.k_norm": false,
501
- "model.layers.39.self_attn.rope": false,
502
- "model.layers.39.mlp.gate_proj": true,
503
- "model.layers.39.mlp.down_proj": true,
504
- "model.layers.39.mlp.up_proj": true,
505
- "model.layers.39.input_layernorm": false,
506
- "model.layers.39.post_attention_layernorm": false,
507
- "model.layers.40.self_attn.q_proj": true,
508
- "model.layers.40.self_attn.k_proj": true,
509
- "model.layers.40.self_attn.v_proj": true,
510
- "model.layers.40.self_attn.o_proj": true,
511
- "model.layers.40.self_attn.q_norm": false,
512
- "model.layers.40.self_attn.k_norm": false,
513
- "model.layers.40.self_attn.rope": false,
514
- "model.layers.40.mlp.gate_proj": true,
515
- "model.layers.40.mlp.down_proj": true,
516
- "model.layers.40.mlp.up_proj": true,
517
- "model.layers.40.input_layernorm": false,
518
- "model.layers.40.post_attention_layernorm": false,
519
- "model.layers.41.self_attn.q_proj": true,
520
- "model.layers.41.self_attn.k_proj": true,
521
- "model.layers.41.self_attn.v_proj": true,
522
- "model.layers.41.self_attn.o_proj": true,
523
- "model.layers.41.self_attn.q_norm": false,
524
- "model.layers.41.self_attn.k_norm": false,
525
- "model.layers.41.self_attn.rope": false,
526
- "model.layers.41.mlp.gate_proj": true,
527
- "model.layers.41.mlp.down_proj": true,
528
- "model.layers.41.mlp.up_proj": true,
529
- "model.layers.41.input_layernorm": false,
530
- "model.layers.41.post_attention_layernorm": false,
531
- "model.layers.42.self_attn.q_proj": true,
532
- "model.layers.42.self_attn.k_proj": true,
533
- "model.layers.42.self_attn.v_proj": true,
534
- "model.layers.42.self_attn.o_proj": true,
535
- "model.layers.42.self_attn.q_norm": false,
536
- "model.layers.42.self_attn.k_norm": false,
537
- "model.layers.42.self_attn.rope": false,
538
- "model.layers.42.mlp.gate_proj": true,
539
- "model.layers.42.mlp.down_proj": true,
540
- "model.layers.42.mlp.up_proj": true,
541
- "model.layers.42.input_layernorm": false,
542
- "model.layers.42.post_attention_layernorm": false,
543
- "model.layers.43.self_attn.q_proj": true,
544
- "model.layers.43.self_attn.k_proj": true,
545
- "model.layers.43.self_attn.v_proj": true,
546
- "model.layers.43.self_attn.o_proj": true,
547
- "model.layers.43.self_attn.q_norm": false,
548
- "model.layers.43.self_attn.k_norm": false,
549
- "model.layers.43.self_attn.rope": false,
550
- "model.layers.43.mlp.gate_proj": true,
551
- "model.layers.43.mlp.down_proj": true,
552
- "model.layers.43.mlp.up_proj": true,
553
- "model.layers.43.input_layernorm": false,
554
- "model.layers.43.post_attention_layernorm": false,
555
- "model.layers.44.self_attn.q_proj": true,
556
- "model.layers.44.self_attn.k_proj": true,
557
- "model.layers.44.self_attn.v_proj": true,
558
- "model.layers.44.self_attn.o_proj": true,
559
- "model.layers.44.self_attn.q_norm": false,
560
- "model.layers.44.self_attn.k_norm": false,
561
- "model.layers.44.self_attn.rope": false,
562
- "model.layers.44.mlp.gate_proj": true,
563
- "model.layers.44.mlp.down_proj": true,
564
- "model.layers.44.mlp.up_proj": true,
565
- "model.layers.44.input_layernorm": false,
566
- "model.layers.44.post_attention_layernorm": false,
567
- "model.layers.45.self_attn.q_proj": true,
568
- "model.layers.45.self_attn.k_proj": true,
569
- "model.layers.45.self_attn.v_proj": true,
570
- "model.layers.45.self_attn.o_proj": true,
571
- "model.layers.45.self_attn.q_norm": false,
572
- "model.layers.45.self_attn.k_norm": false,
573
- "model.layers.45.self_attn.rope": false,
574
- "model.layers.45.mlp.gate_proj": true,
575
- "model.layers.45.mlp.down_proj": true,
576
- "model.layers.45.mlp.up_proj": true,
577
- "model.layers.45.input_layernorm": false,
578
- "model.layers.45.post_attention_layernorm": false,
579
- "model.layers.46.self_attn.q_proj": true,
580
- "model.layers.46.self_attn.k_proj": true,
581
- "model.layers.46.self_attn.v_proj": true,
582
- "model.layers.46.self_attn.o_proj": true,
583
- "model.layers.46.self_attn.q_norm": false,
584
- "model.layers.46.self_attn.k_norm": false,
585
- "model.layers.46.self_attn.rope": false,
586
- "model.layers.46.mlp.gate_proj": true,
587
- "model.layers.46.mlp.down_proj": true,
588
- "model.layers.46.mlp.up_proj": true,
589
- "model.layers.46.input_layernorm": false,
590
- "model.layers.46.post_attention_layernorm": false,
591
- "model.layers.47.self_attn.q_proj": true,
592
- "model.layers.47.self_attn.k_proj": true,
593
- "model.layers.47.self_attn.v_proj": true,
594
- "model.layers.47.self_attn.o_proj": true,
595
- "model.layers.47.self_attn.q_norm": false,
596
- "model.layers.47.self_attn.k_norm": false,
597
- "model.layers.47.self_attn.rope": false,
598
- "model.layers.47.mlp.gate_proj": true,
599
- "model.layers.47.mlp.down_proj": true,
600
- "model.layers.47.mlp.up_proj": true,
601
- "model.layers.47.input_layernorm": false,
602
- "model.layers.47.post_attention_layernorm": false,
603
- "model.layers.48.self_attn.q_proj": true,
604
- "model.layers.48.self_attn.k_proj": true,
605
- "model.layers.48.self_attn.v_proj": true,
606
- "model.layers.48.self_attn.o_proj": true,
607
- "model.layers.48.self_attn.q_norm": false,
608
- "model.layers.48.self_attn.k_norm": false,
609
- "model.layers.48.self_attn.rope": false,
610
- "model.layers.48.mlp.gate_proj": true,
611
- "model.layers.48.mlp.down_proj": true,
612
- "model.layers.48.mlp.up_proj": true,
613
- "model.layers.48.input_layernorm": false,
614
- "model.layers.48.post_attention_layernorm": false,
615
- "model.layers.49.self_attn.q_proj": true,
616
- "model.layers.49.self_attn.k_proj": true,
617
- "model.layers.49.self_attn.v_proj": true,
618
- "model.layers.49.self_attn.o_proj": true,
619
- "model.layers.49.self_attn.q_norm": false,
620
- "model.layers.49.self_attn.k_norm": false,
621
- "model.layers.49.self_attn.rope": false,
622
- "model.layers.49.mlp.gate_proj": true,
623
- "model.layers.49.mlp.down_proj": true,
624
- "model.layers.49.mlp.up_proj": true,
625
- "model.layers.49.input_layernorm": false,
626
- "model.layers.49.post_attention_layernorm": false,
627
- "model.layers.50.self_attn.q_proj": true,
628
- "model.layers.50.self_attn.k_proj": true,
629
- "model.layers.50.self_attn.v_proj": true,
630
- "model.layers.50.self_attn.o_proj": true,
631
- "model.layers.50.self_attn.q_norm": false,
632
- "model.layers.50.self_attn.k_norm": false,
633
- "model.layers.50.self_attn.rope": false,
634
- "model.layers.50.mlp.gate_proj": true,
635
- "model.layers.50.mlp.down_proj": true,
636
- "model.layers.50.mlp.up_proj": true,
637
- "model.layers.50.input_layernorm": false,
638
- "model.layers.50.post_attention_layernorm": false,
639
- "model.layers.51.self_attn.q_proj": true,
640
- "model.layers.51.self_attn.k_proj": true,
641
- "model.layers.51.self_attn.v_proj": true,
642
- "model.layers.51.self_attn.o_proj": true,
643
- "model.layers.51.self_attn.q_norm": false,
644
- "model.layers.51.self_attn.k_norm": false,
645
- "model.layers.51.self_attn.rope": false,
646
- "model.layers.51.mlp.gate_proj": true,
647
- "model.layers.51.mlp.down_proj": true,
648
- "model.layers.51.mlp.up_proj": true,
649
- "model.layers.51.input_layernorm": false,
650
- "model.layers.51.post_attention_layernorm": false,
651
- "model.layers.52.self_attn.q_proj": true,
652
- "model.layers.52.self_attn.k_proj": true,
653
- "model.layers.52.self_attn.v_proj": true,
654
- "model.layers.52.self_attn.o_proj": true,
655
- "model.layers.52.self_attn.q_norm": false,
656
- "model.layers.52.self_attn.k_norm": false,
657
- "model.layers.52.self_attn.rope": false,
658
- "model.layers.52.mlp.gate_proj": true,
659
- "model.layers.52.mlp.down_proj": true,
660
- "model.layers.52.mlp.up_proj": true,
661
- "model.layers.52.input_layernorm": false,
662
- "model.layers.52.post_attention_layernorm": false,
663
- "model.layers.53.self_attn.q_proj": true,
664
- "model.layers.53.self_attn.k_proj": true,
665
- "model.layers.53.self_attn.v_proj": true,
666
- "model.layers.53.self_attn.o_proj": true,
667
- "model.layers.53.self_attn.q_norm": false,
668
- "model.layers.53.self_attn.k_norm": false,
669
- "model.layers.53.self_attn.rope": false,
670
- "model.layers.53.mlp.gate_proj": true,
671
- "model.layers.53.mlp.down_proj": true,
672
- "model.layers.53.mlp.up_proj": true,
673
- "model.layers.53.input_layernorm": false,
674
- "model.layers.53.post_attention_layernorm": false,
675
- "model.layers.54.self_attn.q_proj": true,
676
- "model.layers.54.self_attn.k_proj": true,
677
- "model.layers.54.self_attn.v_proj": true,
678
- "model.layers.54.self_attn.o_proj": true,
679
- "model.layers.54.self_attn.q_norm": false,
680
- "model.layers.54.self_attn.k_norm": false,
681
- "model.layers.54.self_attn.rope": false,
682
- "model.layers.54.mlp.gate_proj": true,
683
- "model.layers.54.mlp.down_proj": true,
684
- "model.layers.54.mlp.up_proj": true,
685
- "model.layers.54.input_layernorm": false,
686
- "model.layers.54.post_attention_layernorm": false,
687
- "model.norm": false
688
- },
689
- "quantization_config": {
690
- "group_size": 32,
691
- "bits": 6,
692
- "model.embed_tokens": true,
693
- "model.layers.0.self_attn.q_proj": true,
694
- "model.layers.0.self_attn.k_proj": true,
695
- "model.layers.0.self_attn.v_proj": true,
696
- "model.layers.0.self_attn.o_proj": true,
697
- "model.layers.0.self_attn.q_norm": false,
698
- "model.layers.0.self_attn.k_norm": false,
699
- "model.layers.0.self_attn.rope": false,
700
- "model.layers.0.mlp.gate_proj": true,
701
- "model.layers.0.mlp.down_proj": true,
702
- "model.layers.0.mlp.up_proj": true,
703
- "model.layers.0.input_layernorm": false,
704
- "model.layers.0.post_attention_layernorm": false,
705
- "model.layers.1.self_attn.q_proj": true,
706
- "model.layers.1.self_attn.k_proj": true,
707
- "model.layers.1.self_attn.v_proj": true,
708
- "model.layers.1.self_attn.o_proj": true,
709
- "model.layers.1.self_attn.q_norm": false,
710
- "model.layers.1.self_attn.k_norm": false,
711
- "model.layers.1.self_attn.rope": false,
712
- "model.layers.1.mlp.gate_proj": true,
713
- "model.layers.1.mlp.down_proj": true,
714
- "model.layers.1.mlp.up_proj": true,
715
- "model.layers.1.input_layernorm": false,
716
- "model.layers.1.post_attention_layernorm": false,
717
- "model.layers.2.self_attn.q_proj": true,
718
- "model.layers.2.self_attn.k_proj": true,
719
- "model.layers.2.self_attn.v_proj": true,
720
- "model.layers.2.self_attn.o_proj": true,
721
- "model.layers.2.self_attn.q_norm": false,
722
- "model.layers.2.self_attn.k_norm": false,
723
- "model.layers.2.self_attn.rope": false,
724
- "model.layers.2.mlp.gate_proj": true,
725
- "model.layers.2.mlp.down_proj": true,
726
- "model.layers.2.mlp.up_proj": true,
727
- "model.layers.2.input_layernorm": false,
728
- "model.layers.2.post_attention_layernorm": false,
729
- "model.layers.3.self_attn.q_proj": true,
730
- "model.layers.3.self_attn.k_proj": true,
731
- "model.layers.3.self_attn.v_proj": true,
732
- "model.layers.3.self_attn.o_proj": true,
733
- "model.layers.3.self_attn.q_norm": false,
734
- "model.layers.3.self_attn.k_norm": false,
735
- "model.layers.3.self_attn.rope": false,
736
- "model.layers.3.mlp.gate_proj": true,
737
- "model.layers.3.mlp.down_proj": true,
738
- "model.layers.3.mlp.up_proj": true,
739
- "model.layers.3.input_layernorm": false,
740
- "model.layers.3.post_attention_layernorm": false,
741
- "model.layers.4.self_attn.q_proj": true,
742
- "model.layers.4.self_attn.k_proj": true,
743
- "model.layers.4.self_attn.v_proj": true,
744
- "model.layers.4.self_attn.o_proj": true,
745
- "model.layers.4.self_attn.q_norm": false,
746
- "model.layers.4.self_attn.k_norm": false,
747
- "model.layers.4.self_attn.rope": false,
748
- "model.layers.4.mlp.gate_proj": true,
749
- "model.layers.4.mlp.down_proj": true,
750
- "model.layers.4.mlp.up_proj": true,
751
- "model.layers.4.input_layernorm": false,
752
- "model.layers.4.post_attention_layernorm": false,
753
- "model.layers.5.self_attn.q_proj": true,
754
- "model.layers.5.self_attn.k_proj": true,
755
- "model.layers.5.self_attn.v_proj": true,
756
- "model.layers.5.self_attn.o_proj": true,
757
- "model.layers.5.self_attn.q_norm": false,
758
- "model.layers.5.self_attn.k_norm": false,
759
- "model.layers.5.self_attn.rope": false,
760
- "model.layers.5.mlp.gate_proj": true,
761
- "model.layers.5.mlp.down_proj": true,
762
- "model.layers.5.mlp.up_proj": true,
763
- "model.layers.5.input_layernorm": false,
764
- "model.layers.5.post_attention_layernorm": false,
765
- "model.layers.6.self_attn.q_proj": true,
766
- "model.layers.6.self_attn.k_proj": true,
767
- "model.layers.6.self_attn.v_proj": true,
768
- "model.layers.6.self_attn.o_proj": true,
769
- "model.layers.6.self_attn.q_norm": false,
770
- "model.layers.6.self_attn.k_norm": false,
771
- "model.layers.6.self_attn.rope": false,
772
- "model.layers.6.mlp.gate_proj": true,
773
- "model.layers.6.mlp.down_proj": true,
774
- "model.layers.6.mlp.up_proj": true,
775
- "model.layers.6.input_layernorm": false,
776
- "model.layers.6.post_attention_layernorm": false,
777
- "model.layers.7.self_attn.q_proj": true,
778
- "model.layers.7.self_attn.k_proj": true,
779
- "model.layers.7.self_attn.v_proj": true,
780
- "model.layers.7.self_attn.o_proj": true,
781
- "model.layers.7.self_attn.q_norm": false,
782
- "model.layers.7.self_attn.k_norm": false,
783
- "model.layers.7.self_attn.rope": false,
784
- "model.layers.7.mlp.gate_proj": true,
785
- "model.layers.7.mlp.down_proj": true,
786
- "model.layers.7.mlp.up_proj": true,
787
- "model.layers.7.input_layernorm": false,
788
- "model.layers.7.post_attention_layernorm": false,
789
- "model.layers.8.self_attn.q_proj": true,
790
- "model.layers.8.self_attn.k_proj": true,
791
- "model.layers.8.self_attn.v_proj": true,
792
- "model.layers.8.self_attn.o_proj": true,
793
- "model.layers.8.self_attn.q_norm": false,
794
- "model.layers.8.self_attn.k_norm": false,
795
- "model.layers.8.self_attn.rope": false,
796
- "model.layers.8.mlp.gate_proj": true,
797
- "model.layers.8.mlp.down_proj": true,
798
- "model.layers.8.mlp.up_proj": true,
799
- "model.layers.8.input_layernorm": false,
800
- "model.layers.8.post_attention_layernorm": false,
801
- "model.layers.9.self_attn.q_proj": true,
802
- "model.layers.9.self_attn.k_proj": true,
803
- "model.layers.9.self_attn.v_proj": true,
804
- "model.layers.9.self_attn.o_proj": true,
805
- "model.layers.9.self_attn.q_norm": false,
806
- "model.layers.9.self_attn.k_norm": false,
807
- "model.layers.9.self_attn.rope": false,
808
- "model.layers.9.mlp.gate_proj": true,
809
- "model.layers.9.mlp.down_proj": true,
810
- "model.layers.9.mlp.up_proj": true,
811
- "model.layers.9.input_layernorm": false,
812
- "model.layers.9.post_attention_layernorm": false,
813
- "model.layers.10.self_attn.q_proj": true,
814
- "model.layers.10.self_attn.k_proj": true,
815
- "model.layers.10.self_attn.v_proj": true,
816
- "model.layers.10.self_attn.o_proj": true,
817
- "model.layers.10.self_attn.q_norm": false,
818
- "model.layers.10.self_attn.k_norm": false,
819
- "model.layers.10.self_attn.rope": false,
820
- "model.layers.10.mlp.gate_proj": true,
821
- "model.layers.10.mlp.down_proj": true,
822
- "model.layers.10.mlp.up_proj": true,
823
- "model.layers.10.input_layernorm": false,
824
- "model.layers.10.post_attention_layernorm": false,
825
- "model.layers.11.self_attn.q_proj": true,
826
- "model.layers.11.self_attn.k_proj": true,
827
- "model.layers.11.self_attn.v_proj": true,
828
- "model.layers.11.self_attn.o_proj": true,
829
- "model.layers.11.self_attn.q_norm": false,
830
- "model.layers.11.self_attn.k_norm": false,
831
- "model.layers.11.self_attn.rope": false,
832
- "model.layers.11.mlp.gate_proj": true,
833
- "model.layers.11.mlp.down_proj": true,
834
- "model.layers.11.mlp.up_proj": true,
835
- "model.layers.11.input_layernorm": false,
836
- "model.layers.11.post_attention_layernorm": false,
837
- "model.layers.12.self_attn.q_proj": true,
838
- "model.layers.12.self_attn.k_proj": true,
839
- "model.layers.12.self_attn.v_proj": true,
840
- "model.layers.12.self_attn.o_proj": true,
841
- "model.layers.12.self_attn.q_norm": false,
842
- "model.layers.12.self_attn.k_norm": false,
843
- "model.layers.12.self_attn.rope": false,
844
- "model.layers.12.mlp.gate_proj": true,
845
- "model.layers.12.mlp.down_proj": true,
846
- "model.layers.12.mlp.up_proj": true,
847
- "model.layers.12.input_layernorm": false,
848
- "model.layers.12.post_attention_layernorm": false,
849
- "model.layers.13.self_attn.q_proj": true,
850
- "model.layers.13.self_attn.k_proj": true,
851
- "model.layers.13.self_attn.v_proj": true,
852
- "model.layers.13.self_attn.o_proj": true,
853
- "model.layers.13.self_attn.q_norm": false,
854
- "model.layers.13.self_attn.k_norm": false,
855
- "model.layers.13.self_attn.rope": false,
856
- "model.layers.13.mlp.gate_proj": true,
857
- "model.layers.13.mlp.down_proj": true,
858
- "model.layers.13.mlp.up_proj": true,
859
- "model.layers.13.input_layernorm": false,
860
- "model.layers.13.post_attention_layernorm": false,
861
- "model.layers.14.self_attn.q_proj": true,
862
- "model.layers.14.self_attn.k_proj": true,
863
- "model.layers.14.self_attn.v_proj": true,
864
- "model.layers.14.self_attn.o_proj": true,
865
- "model.layers.14.self_attn.q_norm": false,
866
- "model.layers.14.self_attn.k_norm": false,
867
- "model.layers.14.self_attn.rope": false,
868
- "model.layers.14.mlp.gate_proj": true,
869
- "model.layers.14.mlp.down_proj": true,
870
- "model.layers.14.mlp.up_proj": true,
871
- "model.layers.14.input_layernorm": false,
872
- "model.layers.14.post_attention_layernorm": false,
873
- "model.layers.15.self_attn.q_proj": true,
874
- "model.layers.15.self_attn.k_proj": true,
875
- "model.layers.15.self_attn.v_proj": true,
876
- "model.layers.15.self_attn.o_proj": true,
877
- "model.layers.15.self_attn.q_norm": false,
878
- "model.layers.15.self_attn.k_norm": false,
879
- "model.layers.15.self_attn.rope": false,
880
- "model.layers.15.mlp.gate_proj": true,
881
- "model.layers.15.mlp.down_proj": true,
882
- "model.layers.15.mlp.up_proj": true,
883
- "model.layers.15.input_layernorm": false,
884
- "model.layers.15.post_attention_layernorm": false,
885
- "model.layers.16.self_attn.q_proj": true,
886
- "model.layers.16.self_attn.k_proj": true,
887
- "model.layers.16.self_attn.v_proj": true,
888
- "model.layers.16.self_attn.o_proj": true,
889
- "model.layers.16.self_attn.q_norm": false,
890
- "model.layers.16.self_attn.k_norm": false,
891
- "model.layers.16.self_attn.rope": false,
892
- "model.layers.16.mlp.gate_proj": true,
893
- "model.layers.16.mlp.down_proj": {
894
- "bits": 8,
895
- "group_size": 32
896
- },
897
- "model.layers.16.mlp.up_proj": true,
898
- "model.layers.16.input_layernorm": false,
899
- "model.layers.16.post_attention_layernorm": false,
900
- "model.layers.17.self_attn.q_proj": true,
901
- "model.layers.17.self_attn.k_proj": true,
902
- "model.layers.17.self_attn.v_proj": true,
903
- "model.layers.17.self_attn.o_proj": true,
904
- "model.layers.17.self_attn.q_norm": false,
905
- "model.layers.17.self_attn.k_norm": false,
906
- "model.layers.17.self_attn.rope": false,
907
- "model.layers.17.mlp.gate_proj": true,
908
- "model.layers.17.mlp.down_proj": true,
909
- "model.layers.17.mlp.up_proj": true,
910
- "model.layers.17.input_layernorm": false,
911
- "model.layers.17.post_attention_layernorm": false,
912
- "model.layers.18.self_attn.q_proj": true,
913
- "model.layers.18.self_attn.k_proj": true,
914
- "model.layers.18.self_attn.v_proj": true,
915
- "model.layers.18.self_attn.o_proj": true,
916
- "model.layers.18.self_attn.q_norm": false,
917
- "model.layers.18.self_attn.k_norm": false,
918
- "model.layers.18.self_attn.rope": false,
919
- "model.layers.18.mlp.gate_proj": true,
920
- "model.layers.18.mlp.down_proj": true,
921
- "model.layers.18.mlp.up_proj": true,
922
- "model.layers.18.input_layernorm": false,
923
- "model.layers.18.post_attention_layernorm": false,
924
- "model.layers.19.self_attn.q_proj": true,
925
- "model.layers.19.self_attn.k_proj": true,
926
- "model.layers.19.self_attn.v_proj": true,
927
- "model.layers.19.self_attn.o_proj": true,
928
- "model.layers.19.self_attn.q_norm": false,
929
- "model.layers.19.self_attn.k_norm": false,
930
- "model.layers.19.self_attn.rope": false,
931
- "model.layers.19.mlp.gate_proj": true,
932
- "model.layers.19.mlp.down_proj": true,
933
- "model.layers.19.mlp.up_proj": true,
934
- "model.layers.19.input_layernorm": false,
935
- "model.layers.19.post_attention_layernorm": false,
936
- "model.layers.20.self_attn.q_proj": true,
937
- "model.layers.20.self_attn.k_proj": true,
938
- "model.layers.20.self_attn.v_proj": true,
939
- "model.layers.20.self_attn.o_proj": true,
940
- "model.layers.20.self_attn.q_norm": false,
941
- "model.layers.20.self_attn.k_norm": false,
942
- "model.layers.20.self_attn.rope": false,
943
- "model.layers.20.mlp.gate_proj": true,
944
- "model.layers.20.mlp.down_proj": true,
945
- "model.layers.20.mlp.up_proj": true,
946
- "model.layers.20.input_layernorm": false,
947
- "model.layers.20.post_attention_layernorm": false,
948
- "model.layers.21.self_attn.q_proj": true,
949
- "model.layers.21.self_attn.k_proj": true,
950
- "model.layers.21.self_attn.v_proj": true,
951
- "model.layers.21.self_attn.o_proj": true,
952
- "model.layers.21.self_attn.q_norm": false,
953
- "model.layers.21.self_attn.k_norm": false,
954
- "model.layers.21.self_attn.rope": false,
955
- "model.layers.21.mlp.gate_proj": true,
956
- "model.layers.21.mlp.down_proj": true,
957
- "model.layers.21.mlp.up_proj": true,
958
- "model.layers.21.input_layernorm": false,
959
- "model.layers.21.post_attention_layernorm": false,
960
- "model.layers.22.self_attn.q_proj": true,
961
- "model.layers.22.self_attn.k_proj": true,
962
- "model.layers.22.self_attn.v_proj": true,
963
- "model.layers.22.self_attn.o_proj": true,
964
- "model.layers.22.self_attn.q_norm": false,
965
- "model.layers.22.self_attn.k_norm": false,
966
- "model.layers.22.self_attn.rope": false,
967
- "model.layers.22.mlp.gate_proj": true,
968
- "model.layers.22.mlp.down_proj": true,
969
- "model.layers.22.mlp.up_proj": true,
970
- "model.layers.22.input_layernorm": false,
971
- "model.layers.22.post_attention_layernorm": false,
972
- "model.layers.23.self_attn.q_proj": true,
973
- "model.layers.23.self_attn.k_proj": true,
974
- "model.layers.23.self_attn.v_proj": true,
975
- "model.layers.23.self_attn.o_proj": true,
976
- "model.layers.23.self_attn.q_norm": false,
977
- "model.layers.23.self_attn.k_norm": false,
978
- "model.layers.23.self_attn.rope": false,
979
- "model.layers.23.mlp.gate_proj": true,
980
- "model.layers.23.mlp.down_proj": true,
981
- "model.layers.23.mlp.up_proj": true,
982
- "model.layers.23.input_layernorm": false,
983
- "model.layers.23.post_attention_layernorm": false,
984
- "model.layers.24.self_attn.q_proj": true,
985
- "model.layers.24.self_attn.k_proj": true,
986
- "model.layers.24.self_attn.v_proj": true,
987
- "model.layers.24.self_attn.o_proj": true,
988
- "model.layers.24.self_attn.q_norm": false,
989
- "model.layers.24.self_attn.k_norm": false,
990
- "model.layers.24.self_attn.rope": false,
991
- "model.layers.24.mlp.gate_proj": true,
992
- "model.layers.24.mlp.down_proj": true,
993
- "model.layers.24.mlp.up_proj": true,
994
- "model.layers.24.input_layernorm": false,
995
- "model.layers.24.post_attention_layernorm": false,
996
- "model.layers.25.self_attn.q_proj": true,
997
- "model.layers.25.self_attn.k_proj": true,
998
- "model.layers.25.self_attn.v_proj": true,
999
- "model.layers.25.self_attn.o_proj": true,
1000
- "model.layers.25.self_attn.q_norm": false,
1001
- "model.layers.25.self_attn.k_norm": false,
1002
- "model.layers.25.self_attn.rope": false,
1003
- "model.layers.25.mlp.gate_proj": true,
1004
- "model.layers.25.mlp.down_proj": true,
1005
- "model.layers.25.mlp.up_proj": true,
1006
- "model.layers.25.input_layernorm": false,
1007
- "model.layers.25.post_attention_layernorm": false,
1008
- "model.layers.26.self_attn.q_proj": true,
1009
- "model.layers.26.self_attn.k_proj": true,
1010
- "model.layers.26.self_attn.v_proj": true,
1011
- "model.layers.26.self_attn.o_proj": true,
1012
- "model.layers.26.self_attn.q_norm": false,
1013
- "model.layers.26.self_attn.k_norm": false,
1014
- "model.layers.26.self_attn.rope": false,
1015
- "model.layers.26.mlp.gate_proj": true,
1016
- "model.layers.26.mlp.down_proj": true,
1017
- "model.layers.26.mlp.up_proj": true,
1018
- "model.layers.26.input_layernorm": false,
1019
- "model.layers.26.post_attention_layernorm": false,
1020
- "model.layers.27.self_attn.q_proj": true,
1021
- "model.layers.27.self_attn.k_proj": true,
1022
- "model.layers.27.self_attn.v_proj": true,
1023
- "model.layers.27.self_attn.o_proj": true,
1024
- "model.layers.27.self_attn.q_norm": false,
1025
- "model.layers.27.self_attn.k_norm": false,
1026
- "model.layers.27.self_attn.rope": false,
1027
- "model.layers.27.mlp.gate_proj": true,
1028
- "model.layers.27.mlp.down_proj": true,
1029
- "model.layers.27.mlp.up_proj": true,
1030
- "model.layers.27.input_layernorm": false,
1031
- "model.layers.27.post_attention_layernorm": false,
1032
- "model.layers.28.self_attn.q_proj": true,
1033
- "model.layers.28.self_attn.k_proj": true,
1034
- "model.layers.28.self_attn.v_proj": true,
1035
- "model.layers.28.self_attn.o_proj": true,
1036
- "model.layers.28.self_attn.q_norm": false,
1037
- "model.layers.28.self_attn.k_norm": false,
1038
- "model.layers.28.self_attn.rope": false,
1039
- "model.layers.28.mlp.gate_proj": true,
1040
- "model.layers.28.mlp.down_proj": true,
1041
- "model.layers.28.mlp.up_proj": true,
1042
- "model.layers.28.input_layernorm": false,
1043
- "model.layers.28.post_attention_layernorm": false,
1044
- "model.layers.29.self_attn.q_proj": true,
1045
- "model.layers.29.self_attn.k_proj": true,
1046
- "model.layers.29.self_attn.v_proj": true,
1047
- "model.layers.29.self_attn.o_proj": true,
1048
- "model.layers.29.self_attn.q_norm": false,
1049
- "model.layers.29.self_attn.k_norm": false,
1050
- "model.layers.29.self_attn.rope": false,
1051
- "model.layers.29.mlp.gate_proj": true,
1052
- "model.layers.29.mlp.down_proj": true,
1053
- "model.layers.29.mlp.up_proj": true,
1054
- "model.layers.29.input_layernorm": false,
1055
- "model.layers.29.post_attention_layernorm": false,
1056
- "model.layers.30.self_attn.q_proj": true,
1057
- "model.layers.30.self_attn.k_proj": true,
1058
- "model.layers.30.self_attn.v_proj": true,
1059
- "model.layers.30.self_attn.o_proj": true,
1060
- "model.layers.30.self_attn.q_norm": false,
1061
- "model.layers.30.self_attn.k_norm": false,
1062
- "model.layers.30.self_attn.rope": false,
1063
- "model.layers.30.mlp.gate_proj": true,
1064
- "model.layers.30.mlp.down_proj": true,
1065
- "model.layers.30.mlp.up_proj": true,
1066
- "model.layers.30.input_layernorm": false,
1067
- "model.layers.30.post_attention_layernorm": false,
1068
- "model.layers.31.self_attn.q_proj": true,
1069
- "model.layers.31.self_attn.k_proj": true,
1070
- "model.layers.31.self_attn.v_proj": true,
1071
- "model.layers.31.self_attn.o_proj": true,
1072
- "model.layers.31.self_attn.q_norm": false,
1073
- "model.layers.31.self_attn.k_norm": false,
1074
- "model.layers.31.self_attn.rope": false,
1075
- "model.layers.31.mlp.gate_proj": true,
1076
- "model.layers.31.mlp.down_proj": true,
1077
- "model.layers.31.mlp.up_proj": true,
1078
- "model.layers.31.input_layernorm": false,
1079
- "model.layers.31.post_attention_layernorm": false,
1080
- "model.layers.32.self_attn.q_proj": true,
1081
- "model.layers.32.self_attn.k_proj": true,
1082
- "model.layers.32.self_attn.v_proj": true,
1083
- "model.layers.32.self_attn.o_proj": true,
1084
- "model.layers.32.self_attn.q_norm": false,
1085
- "model.layers.32.self_attn.k_norm": false,
1086
- "model.layers.32.self_attn.rope": false,
1087
- "model.layers.32.mlp.gate_proj": true,
1088
- "model.layers.32.mlp.down_proj": true,
1089
- "model.layers.32.mlp.up_proj": true,
1090
- "model.layers.32.input_layernorm": false,
1091
- "model.layers.32.post_attention_layernorm": false,
1092
- "model.layers.33.self_attn.q_proj": true,
1093
- "model.layers.33.self_attn.k_proj": true,
1094
- "model.layers.33.self_attn.v_proj": true,
1095
- "model.layers.33.self_attn.o_proj": true,
1096
- "model.layers.33.self_attn.q_norm": false,
1097
- "model.layers.33.self_attn.k_norm": false,
1098
- "model.layers.33.self_attn.rope": false,
1099
- "model.layers.33.mlp.gate_proj": true,
1100
- "model.layers.33.mlp.down_proj": true,
1101
- "model.layers.33.mlp.up_proj": true,
1102
- "model.layers.33.input_layernorm": false,
1103
- "model.layers.33.post_attention_layernorm": false,
1104
- "model.layers.34.self_attn.q_proj": true,
1105
- "model.layers.34.self_attn.k_proj": true,
1106
- "model.layers.34.self_attn.v_proj": true,
1107
- "model.layers.34.self_attn.o_proj": true,
1108
- "model.layers.34.self_attn.q_norm": false,
1109
- "model.layers.34.self_attn.k_norm": false,
1110
- "model.layers.34.self_attn.rope": false,
1111
- "model.layers.34.mlp.gate_proj": true,
1112
- "model.layers.34.mlp.down_proj": true,
1113
- "model.layers.34.mlp.up_proj": true,
1114
- "model.layers.34.input_layernorm": false,
1115
- "model.layers.34.post_attention_layernorm": false,
1116
- "model.layers.35.self_attn.q_proj": true,
1117
- "model.layers.35.self_attn.k_proj": true,
1118
- "model.layers.35.self_attn.v_proj": true,
1119
- "model.layers.35.self_attn.o_proj": true,
1120
- "model.layers.35.self_attn.q_norm": false,
1121
- "model.layers.35.self_attn.k_norm": false,
1122
- "model.layers.35.self_attn.rope": false,
1123
- "model.layers.35.mlp.gate_proj": true,
1124
- "model.layers.35.mlp.down_proj": true,
1125
- "model.layers.35.mlp.up_proj": true,
1126
- "model.layers.35.input_layernorm": false,
1127
- "model.layers.35.post_attention_layernorm": false,
1128
- "model.layers.36.self_attn.q_proj": true,
1129
- "model.layers.36.self_attn.k_proj": true,
1130
- "model.layers.36.self_attn.v_proj": true,
1131
- "model.layers.36.self_attn.o_proj": true,
1132
- "model.layers.36.self_attn.q_norm": false,
1133
- "model.layers.36.self_attn.k_norm": false,
1134
- "model.layers.36.self_attn.rope": false,
1135
- "model.layers.36.mlp.gate_proj": true,
1136
- "model.layers.36.mlp.down_proj": true,
1137
- "model.layers.36.mlp.up_proj": true,
1138
- "model.layers.36.input_layernorm": false,
1139
- "model.layers.36.post_attention_layernorm": false,
1140
- "model.layers.37.self_attn.q_proj": true,
1141
- "model.layers.37.self_attn.k_proj": true,
1142
- "model.layers.37.self_attn.v_proj": true,
1143
- "model.layers.37.self_attn.o_proj": true,
1144
- "model.layers.37.self_attn.q_norm": false,
1145
- "model.layers.37.self_attn.k_norm": false,
1146
- "model.layers.37.self_attn.rope": false,
1147
- "model.layers.37.mlp.gate_proj": true,
1148
- "model.layers.37.mlp.down_proj": true,
1149
- "model.layers.37.mlp.up_proj": true,
1150
- "model.layers.37.input_layernorm": false,
1151
- "model.layers.37.post_attention_layernorm": false,
1152
- "model.layers.38.self_attn.q_proj": true,
1153
- "model.layers.38.self_attn.k_proj": true,
1154
- "model.layers.38.self_attn.v_proj": true,
1155
- "model.layers.38.self_attn.o_proj": true,
1156
- "model.layers.38.self_attn.q_norm": false,
1157
- "model.layers.38.self_attn.k_norm": false,
1158
- "model.layers.38.self_attn.rope": false,
1159
- "model.layers.38.mlp.gate_proj": true,
1160
- "model.layers.38.mlp.down_proj": true,
1161
- "model.layers.38.mlp.up_proj": true,
1162
- "model.layers.38.input_layernorm": false,
1163
- "model.layers.38.post_attention_layernorm": false,
1164
- "model.layers.39.self_attn.q_proj": true,
1165
- "model.layers.39.self_attn.k_proj": true,
1166
- "model.layers.39.self_attn.v_proj": true,
1167
- "model.layers.39.self_attn.o_proj": true,
1168
- "model.layers.39.self_attn.q_norm": false,
1169
- "model.layers.39.self_attn.k_norm": false,
1170
- "model.layers.39.self_attn.rope": false,
1171
- "model.layers.39.mlp.gate_proj": true,
1172
- "model.layers.39.mlp.down_proj": true,
1173
- "model.layers.39.mlp.up_proj": true,
1174
- "model.layers.39.input_layernorm": false,
1175
- "model.layers.39.post_attention_layernorm": false,
1176
- "model.layers.40.self_attn.q_proj": true,
1177
- "model.layers.40.self_attn.k_proj": true,
1178
- "model.layers.40.self_attn.v_proj": true,
1179
- "model.layers.40.self_attn.o_proj": true,
1180
- "model.layers.40.self_attn.q_norm": false,
1181
- "model.layers.40.self_attn.k_norm": false,
1182
- "model.layers.40.self_attn.rope": false,
1183
- "model.layers.40.mlp.gate_proj": true,
1184
- "model.layers.40.mlp.down_proj": true,
1185
- "model.layers.40.mlp.up_proj": true,
1186
- "model.layers.40.input_layernorm": false,
1187
- "model.layers.40.post_attention_layernorm": false,
1188
- "model.layers.41.self_attn.q_proj": true,
1189
- "model.layers.41.self_attn.k_proj": true,
1190
- "model.layers.41.self_attn.v_proj": true,
1191
- "model.layers.41.self_attn.o_proj": true,
1192
- "model.layers.41.self_attn.q_norm": false,
1193
- "model.layers.41.self_attn.k_norm": false,
1194
- "model.layers.41.self_attn.rope": false,
1195
- "model.layers.41.mlp.gate_proj": true,
1196
- "model.layers.41.mlp.down_proj": true,
1197
- "model.layers.41.mlp.up_proj": true,
1198
- "model.layers.41.input_layernorm": false,
1199
- "model.layers.41.post_attention_layernorm": false,
1200
- "model.layers.42.self_attn.q_proj": true,
1201
- "model.layers.42.self_attn.k_proj": true,
1202
- "model.layers.42.self_attn.v_proj": true,
1203
- "model.layers.42.self_attn.o_proj": true,
1204
- "model.layers.42.self_attn.q_norm": false,
1205
- "model.layers.42.self_attn.k_norm": false,
1206
- "model.layers.42.self_attn.rope": false,
1207
- "model.layers.42.mlp.gate_proj": true,
1208
- "model.layers.42.mlp.down_proj": true,
1209
- "model.layers.42.mlp.up_proj": true,
1210
- "model.layers.42.input_layernorm": false,
1211
- "model.layers.42.post_attention_layernorm": false,
1212
- "model.layers.43.self_attn.q_proj": true,
1213
- "model.layers.43.self_attn.k_proj": true,
1214
- "model.layers.43.self_attn.v_proj": true,
1215
- "model.layers.43.self_attn.o_proj": true,
1216
- "model.layers.43.self_attn.q_norm": false,
1217
- "model.layers.43.self_attn.k_norm": false,
1218
- "model.layers.43.self_attn.rope": false,
1219
- "model.layers.43.mlp.gate_proj": true,
1220
- "model.layers.43.mlp.down_proj": true,
1221
- "model.layers.43.mlp.up_proj": true,
1222
- "model.layers.43.input_layernorm": false,
1223
- "model.layers.43.post_attention_layernorm": false,
1224
- "model.layers.44.self_attn.q_proj": true,
1225
- "model.layers.44.self_attn.k_proj": true,
1226
- "model.layers.44.self_attn.v_proj": true,
1227
- "model.layers.44.self_attn.o_proj": true,
1228
- "model.layers.44.self_attn.q_norm": false,
1229
- "model.layers.44.self_attn.k_norm": false,
1230
- "model.layers.44.self_attn.rope": false,
1231
- "model.layers.44.mlp.gate_proj": true,
1232
- "model.layers.44.mlp.down_proj": true,
1233
- "model.layers.44.mlp.up_proj": true,
1234
- "model.layers.44.input_layernorm": false,
1235
- "model.layers.44.post_attention_layernorm": false,
1236
- "model.layers.45.self_attn.q_proj": true,
1237
- "model.layers.45.self_attn.k_proj": true,
1238
- "model.layers.45.self_attn.v_proj": true,
1239
- "model.layers.45.self_attn.o_proj": true,
1240
- "model.layers.45.self_attn.q_norm": false,
1241
- "model.layers.45.self_attn.k_norm": false,
1242
- "model.layers.45.self_attn.rope": false,
1243
- "model.layers.45.mlp.gate_proj": true,
1244
- "model.layers.45.mlp.down_proj": true,
1245
- "model.layers.45.mlp.up_proj": true,
1246
- "model.layers.45.input_layernorm": false,
1247
- "model.layers.45.post_attention_layernorm": false,
1248
- "model.layers.46.self_attn.q_proj": true,
1249
- "model.layers.46.self_attn.k_proj": true,
1250
- "model.layers.46.self_attn.v_proj": true,
1251
- "model.layers.46.self_attn.o_proj": true,
1252
- "model.layers.46.self_attn.q_norm": false,
1253
- "model.layers.46.self_attn.k_norm": false,
1254
- "model.layers.46.self_attn.rope": false,
1255
- "model.layers.46.mlp.gate_proj": true,
1256
- "model.layers.46.mlp.down_proj": true,
1257
- "model.layers.46.mlp.up_proj": true,
1258
- "model.layers.46.input_layernorm": false,
1259
- "model.layers.46.post_attention_layernorm": false,
1260
- "model.layers.47.self_attn.q_proj": true,
1261
- "model.layers.47.self_attn.k_proj": true,
1262
- "model.layers.47.self_attn.v_proj": true,
1263
- "model.layers.47.self_attn.o_proj": true,
1264
- "model.layers.47.self_attn.q_norm": false,
1265
- "model.layers.47.self_attn.k_norm": false,
1266
- "model.layers.47.self_attn.rope": false,
1267
- "model.layers.47.mlp.gate_proj": true,
1268
- "model.layers.47.mlp.down_proj": true,
1269
- "model.layers.47.mlp.up_proj": true,
1270
- "model.layers.47.input_layernorm": false,
1271
- "model.layers.47.post_attention_layernorm": false,
1272
- "model.layers.48.self_attn.q_proj": true,
1273
- "model.layers.48.self_attn.k_proj": true,
1274
- "model.layers.48.self_attn.v_proj": true,
1275
- "model.layers.48.self_attn.o_proj": true,
1276
- "model.layers.48.self_attn.q_norm": false,
1277
- "model.layers.48.self_attn.k_norm": false,
1278
- "model.layers.48.self_attn.rope": false,
1279
- "model.layers.48.mlp.gate_proj": true,
1280
- "model.layers.48.mlp.down_proj": true,
1281
- "model.layers.48.mlp.up_proj": true,
1282
- "model.layers.48.input_layernorm": false,
1283
- "model.layers.48.post_attention_layernorm": false,
1284
- "model.layers.49.self_attn.q_proj": true,
1285
- "model.layers.49.self_attn.k_proj": true,
1286
- "model.layers.49.self_attn.v_proj": true,
1287
- "model.layers.49.self_attn.o_proj": true,
1288
- "model.layers.49.self_attn.q_norm": false,
1289
- "model.layers.49.self_attn.k_norm": false,
1290
- "model.layers.49.self_attn.rope": false,
1291
- "model.layers.49.mlp.gate_proj": true,
1292
- "model.layers.49.mlp.down_proj": true,
1293
- "model.layers.49.mlp.up_proj": true,
1294
- "model.layers.49.input_layernorm": false,
1295
- "model.layers.49.post_attention_layernorm": false,
1296
- "model.layers.50.self_attn.q_proj": true,
1297
- "model.layers.50.self_attn.k_proj": true,
1298
- "model.layers.50.self_attn.v_proj": true,
1299
- "model.layers.50.self_attn.o_proj": true,
1300
- "model.layers.50.self_attn.q_norm": false,
1301
- "model.layers.50.self_attn.k_norm": false,
1302
- "model.layers.50.self_attn.rope": false,
1303
- "model.layers.50.mlp.gate_proj": true,
1304
- "model.layers.50.mlp.down_proj": true,
1305
- "model.layers.50.mlp.up_proj": true,
1306
- "model.layers.50.input_layernorm": false,
1307
- "model.layers.50.post_attention_layernorm": false,
1308
- "model.layers.51.self_attn.q_proj": true,
1309
- "model.layers.51.self_attn.k_proj": true,
1310
- "model.layers.51.self_attn.v_proj": true,
1311
- "model.layers.51.self_attn.o_proj": true,
1312
- "model.layers.51.self_attn.q_norm": false,
1313
- "model.layers.51.self_attn.k_norm": false,
1314
- "model.layers.51.self_attn.rope": false,
1315
- "model.layers.51.mlp.gate_proj": true,
1316
- "model.layers.51.mlp.down_proj": true,
1317
- "model.layers.51.mlp.up_proj": true,
1318
- "model.layers.51.input_layernorm": false,
1319
- "model.layers.51.post_attention_layernorm": false,
1320
- "model.layers.52.self_attn.q_proj": true,
1321
- "model.layers.52.self_attn.k_proj": true,
1322
- "model.layers.52.self_attn.v_proj": true,
1323
- "model.layers.52.self_attn.o_proj": true,
1324
- "model.layers.52.self_attn.q_norm": false,
1325
- "model.layers.52.self_attn.k_norm": false,
1326
- "model.layers.52.self_attn.rope": false,
1327
- "model.layers.52.mlp.gate_proj": true,
1328
- "model.layers.52.mlp.down_proj": true,
1329
- "model.layers.52.mlp.up_proj": true,
1330
- "model.layers.52.input_layernorm": false,
1331
- "model.layers.52.post_attention_layernorm": false,
1332
- "model.layers.53.self_attn.q_proj": true,
1333
- "model.layers.53.self_attn.k_proj": true,
1334
- "model.layers.53.self_attn.v_proj": true,
1335
- "model.layers.53.self_attn.o_proj": true,
1336
- "model.layers.53.self_attn.q_norm": false,
1337
- "model.layers.53.self_attn.k_norm": false,
1338
- "model.layers.53.self_attn.rope": false,
1339
- "model.layers.53.mlp.gate_proj": true,
1340
- "model.layers.53.mlp.down_proj": true,
1341
- "model.layers.53.mlp.up_proj": true,
1342
- "model.layers.53.input_layernorm": false,
1343
- "model.layers.53.post_attention_layernorm": false,
1344
- "model.layers.54.self_attn.q_proj": true,
1345
- "model.layers.54.self_attn.k_proj": true,
1346
- "model.layers.54.self_attn.v_proj": true,
1347
- "model.layers.54.self_attn.o_proj": true,
1348
- "model.layers.54.self_attn.q_norm": false,
1349
- "model.layers.54.self_attn.k_norm": false,
1350
- "model.layers.54.self_attn.rope": false,
1351
- "model.layers.54.mlp.gate_proj": true,
1352
- "model.layers.54.mlp.down_proj": true,
1353
- "model.layers.54.mlp.up_proj": true,
1354
- "model.layers.54.input_layernorm": false,
1355
- "model.layers.54.post_attention_layernorm": false,
1356
- "model.norm": false
1357
- },
1358
  "rms_norm_eps": 1e-06,
1359
  "rope_scaling": null,
1360
  "rope_theta": 1000000,
 
17
  "num_attention_heads": 32,
18
  "num_hidden_layers": 55,
19
  "num_key_value_heads": 8,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  "rms_norm_eps": 1e-06,
21
  "rope_scaling": null,
22
  "rope_theta": 1000000,
model-00001-of-00003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79157a96d8d05281bc4339706f2e376c90e1d7a7e417cb518467a594578f73d5
3
+ size 5321133357
model-00002-of-00003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7dc9c16a1659356605d17fae457e9718fbe7b155f71b7ea547303f6d7c650559
3
+ size 5348060577
model-00003-of-00003.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79071aedfa6c5e41c29bcfc77aaea2174d00178311d71f798d0ee926433138c9
3
+ size 1211182466
model.safetensors.index.json CHANGED
The diff for this file is too large to render. See raw diff