Hugging Face's logo

eaddario
/
DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation
GGUF
English
quant
experimental
conversational
Model card Files
xet
Community
DeepSeek-R1-Distill-Llama-8B-GGUF / scores /DeepSeek-R1-Distill-Llama-8B-Q8_0.md
eaddario's picture
eaddario
Add GGUF internal file structure
66279ab verified
preview code
|
raw
history blame contribute delete
83.1 kB

DeepSeek-R1-Distill-Llama-8B-Q8_0.gguf - GGUF Internal File Dump

  • Endian: LITTLE endian

Key Value Metadata Store

There are 36 key-value pairs in this file

POS TYPE Count Key Value
1 UINT32 1 GGUF.version 3
2 UINT64 1 GGUF.tensor_count 292
3 UINT64 1 GGUF.kv_count 33
4 STRING 1 general.architecture llama
5 STRING 1 general.type model
6 STRING 1 general.name DeepSeek R1 Distill Llama 8B
7 STRING 1 general.basename DeepSeek-R1-Distill-Llama
8 STRING 1 general.size_label 8B
9 STRING 1 general.license mit
10 UINT32 1 llama.block_count 32
11 UINT32 1 llama.context_length 131072
12 UINT32 1 llama.embedding_length 4096
13 UINT32 1 llama.feed_forward_length 14336
14 UINT32 1 llama.attention.head_count 32
15 UINT32 1 llama.attention.head_count_kv 8
16 FLOAT32 1 llama.rope.freq_base 500000.0
17 FLOAT32 1 llama.attention.layer_norm_rms_epsilon 1e-05
18 UINT32 1 llama.vocab_size 128256
19 UINT32 1 llama.rope.dimension_count 128
20 STRING 1 tokenizer.ggml.model gpt2
21 STRING 1 tokenizer.ggml.pre llama-bpe
22 [STRING] 128256 tokenizer.ggml.tokens [ !, ", #, $, %, ... ]
23 [INT32] 128256 tokenizer.ggml.token_type [ 1, 1, 1, 1, 1, 1, 1, ... ]
24 [STRING] 280147 tokenizer.ggml.merges [ Ġ Ġ, Ġ ĠĠĠ, ĠĠ ĠĠ, ĠĠĠ Ġ, i n, ... ]
25 UINT32 1 tokenizer.ggml.bos_token_id 128000
26 UINT32 1 tokenizer.ggml.eos_token_id 128001
27 UINT32 1 tokenizer.ggml.padding_token_id 128001
28 BOOL 1 tokenizer.ggml.add_bos_token True
29 BOOL 1 tokenizer.ggml.add_eos_token False
30 STRING 1 tokenizer.chat_template {% if not add_generation_promp...{{'<｜Assistant｜>'}}{% endif %}
31 UINT32 1 general.quantization_version 2
32 UINT32 1 general.file_type 7
33 STRING 1 quantize.imatrix.file ./imatrix/imatrix-DeepSeek-R1-Distill-Llama-8B-small.dat
34 STRING 1 quantize.imatrix.dataset ../../datasets/imatrix/calibration_all_small.txt
35 INT32 1 quantize.imatrix.entries_count 225
36 INT32 1 quantize.imatrix.chunks_count 1130

Tensors Overview ~8B Elements

Total number of elements in all tensors: 8030261312 Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID Tensor Layer Name Data Offset (B) Data Size (B)
0 output.weight 0x779a80 0x21450000
1 output_norm.weight 0x21bc9a80 0x4000
2 rope_freqs.weight 0x21bcda80 0x100
3 token_embd.weight 0x21bcdb80 0xd746000
4 blk.0.attn_k.weight 0x2f313b80 0x440000
5 blk.0.attn_norm.weight 0x2f753b80 0x4000
6 blk.0.attn_output.weight 0x2f757b80 0x1100000
7 blk.0.attn_q.weight 0x30857b80 0x1100000
8 blk.0.attn_v.weight 0x31957b80 0x800000
9 blk.0.ffn_down.weight 0x32157b80 0x3b80000
10 blk.0.ffn_gate.weight 0x35cd7b80 0x3b80000
11 blk.0.ffn_norm.weight 0x39857b80 0x4000
12 blk.0.ffn_up.weight 0x3985bb80 0x3b80000
13 blk.1.attn_k.weight 0x3d3dbb80 0x440000
14 blk.1.attn_norm.weight 0x3d81bb80 0x4000
15 blk.1.attn_output.weight 0x3d81fb80 0x1100000
16 blk.1.attn_q.weight 0x3e91fb80 0x1100000
17 blk.1.attn_v.weight 0x3fa1fb80 0x800000
18 blk.1.ffn_down.weight 0x4021fb80 0x3b80000
19 blk.1.ffn_gate.weight 0x43d9fb80 0x3b80000
20 blk.1.ffn_norm.weight 0x4791fb80 0x4000
21 blk.1.ffn_up.weight 0x47923b80 0x3b80000
22 blk.2.attn_k.weight 0x4b4a3b80 0x440000
23 blk.2.attn_norm.weight 0x4b8e3b80 0x4000
24 blk.2.attn_output.weight 0x4b8e7b80 0x1100000
25 blk.2.attn_q.weight 0x4c9e7b80 0x1100000
26 blk.2.attn_v.weight 0x4dae7b80 0x800000
27 blk.2.ffn_down.weight 0x4e2e7b80 0x3b80000
28 blk.2.ffn_gate.weight 0x51e67b80 0x3b80000
29 blk.2.ffn_norm.weight 0x559e7b80 0x4000
30 blk.2.ffn_up.weight 0x559ebb80 0x3b80000
31 blk.3.attn_k.weight 0x5956bb80 0x440000
32 blk.3.attn_norm.weight 0x599abb80 0x4000
33 blk.3.attn_output.weight 0x599afb80 0x1100000
34 blk.3.attn_q.weight 0x5aaafb80 0x1100000
35 blk.3.attn_v.weight 0x5bbafb80 0x800000
36 blk.3.ffn_down.weight 0x5c3afb80 0x3b80000
37 blk.3.ffn_gate.weight 0x5ff2fb80 0x3b80000
38 blk.3.ffn_norm.weight 0x63aafb80 0x4000
39 blk.3.ffn_up.weight 0x63ab3b80 0x3b80000
40 blk.4.attn_k.weight 0x67633b80 0x440000
41 blk.4.attn_norm.weight 0x67a73b80 0x4000
42 blk.4.attn_output.weight 0x67a77b80 0x1100000
43 blk.4.attn_q.weight 0x68b77b80 0x1100000
44 blk.4.attn_v.weight 0x69c77b80 0x800000
45 blk.4.ffn_down.weight 0x6a477b80 0x3b80000
46 blk.4.ffn_gate.weight 0x6dff7b80 0x3b80000
47 blk.4.ffn_norm.weight 0x71b77b80 0x4000
48 blk.4.ffn_up.weight 0x71b7bb80 0x3b80000
49 blk.5.attn_k.weight 0x756fbb80 0x440000
50 blk.5.attn_norm.weight 0x75b3bb80 0x4000
51 blk.5.attn_output.weight 0x75b3fb80 0x1100000
52 blk.5.attn_q.weight 0x76c3fb80 0x1100000
53 blk.5.attn_v.weight 0x77d3fb80 0x800000
54 blk.5.ffn_down.weight 0x7853fb80 0x3b80000
55 blk.5.ffn_gate.weight 0x7c0bfb80 0x3b80000
56 blk.5.ffn_norm.weight 0x7fc3fb80 0x4000
57 blk.5.ffn_up.weight 0x7fc43b80 0x3b80000
58 blk.6.attn_k.weight 0x837c3b80 0x440000
59 blk.6.attn_norm.weight 0x83c03b80 0x4000
60 blk.6.attn_output.weight 0x83c07b80 0x1100000
61 blk.6.attn_q.weight 0x84d07b80 0x1100000
62 blk.6.attn_v.weight 0x85e07b80 0x800000
63 blk.6.ffn_down.weight 0x86607b80 0x3b80000
64 blk.6.ffn_gate.weight 0x8a187b80 0x3b80000
65 blk.6.ffn_norm.weight 0x8dd07b80 0x4000
66 blk.6.ffn_up.weight 0x8dd0bb80 0x3b80000
67 blk.7.attn_k.weight 0x9188bb80 0x440000
68 blk.7.attn_norm.weight 0x91ccbb80 0x4000
69 blk.7.attn_output.weight 0x91ccfb80 0x1100000
70 blk.7.attn_q.weight 0x92dcfb80 0x1100000
71 blk.7.attn_v.weight 0x93ecfb80 0x800000
72 blk.7.ffn_down.weight 0x946cfb80 0x3b80000
73 blk.7.ffn_gate.weight 0x9824fb80 0x3b80000
74 blk.7.ffn_norm.weight 0x9bdcfb80 0x4000
75 blk.7.ffn_up.weight 0x9bdd3b80 0x3b80000
76 blk.8.attn_k.weight 0x9f953b80 0x440000
77 blk.8.attn_norm.weight 0x9fd93b80 0x4000
78 blk.8.attn_output.weight 0x9fd97b80 0x1100000
79 blk.8.attn_q.weight 0xa0e97b80 0x1100000
80 blk.8.attn_v.weight 0xa1f97b80 0x800000
81 blk.8.ffn_down.weight 0xa2797b80 0x3b80000
82 blk.8.ffn_gate.weight 0xa6317b80 0x3b80000
83 blk.8.ffn_norm.weight 0xa9e97b80 0x4000
84 blk.8.ffn_up.weight 0xa9e9bb80 0x3b80000
85 blk.9.attn_k.weight 0xada1bb80 0x440000
86 blk.9.attn_norm.weight 0xade5bb80 0x4000
87 blk.9.attn_output.weight 0xade5fb80 0x1100000
88 blk.9.attn_q.weight 0xaef5fb80 0x1100000
89 blk.9.attn_v.weight 0xb005fb80 0x800000
90 blk.9.ffn_down.weight 0xb085fb80 0x3b80000
91 blk.9.ffn_gate.weight 0xb43dfb80 0x3b80000
92 blk.9.ffn_norm.weight 0xb7f5fb80 0x4000
93 blk.9.ffn_up.weight 0xb7f63b80 0x3b80000
94 blk.10.attn_k.weight 0xbbae3b80 0x440000
95 blk.10.attn_norm.weight 0xbbf23b80 0x4000
96 blk.10.attn_output.weight 0xbbf27b80 0x1100000
97 blk.10.attn_q.weight 0xbd027b80 0x1100000
98 blk.10.attn_v.weight 0xbe127b80 0x800000
99 blk.10.ffn_down.weight 0xbe927b80 0x3b80000
100 blk.10.ffn_gate.weight 0xc24a7b80 0x3b80000
101 blk.10.ffn_norm.weight 0xc6027b80 0x4000
102 blk.10.ffn_up.weight 0xc602bb80 0x3b80000
103 blk.11.attn_k.weight 0xc9babb80 0x440000
104 blk.11.attn_norm.weight 0xc9febb80 0x4000
105 blk.11.attn_output.weight 0xc9fefb80 0x1100000
106 blk.11.attn_q.weight 0xcb0efb80 0x1100000
107 blk.11.attn_v.weight 0xcc1efb80 0x800000
108 blk.11.ffn_down.weight 0xcc9efb80 0x3b80000
109 blk.11.ffn_gate.weight 0xd056fb80 0x3b80000
110 blk.11.ffn_norm.weight 0xd40efb80 0x4000
111 blk.11.ffn_up.weight 0xd40f3b80 0x3b80000
112 blk.12.attn_k.weight 0xd7c73b80 0x440000
113 blk.12.attn_norm.weight 0xd80b3b80 0x4000
114 blk.12.attn_output.weight 0xd80b7b80 0x1100000
115 blk.12.attn_q.weight 0xd91b7b80 0x1100000
116 blk.12.attn_v.weight 0xda2b7b80 0x800000
117 blk.12.ffn_down.weight 0xdaab7b80 0x3b80000
118 blk.12.ffn_gate.weight 0xde637b80 0x3b80000
119 blk.12.ffn_norm.weight 0xe21b7b80 0x4000
120 blk.12.ffn_up.weight 0xe21bbb80 0x3b80000
121 blk.13.attn_k.weight 0xe5d3bb80 0x440000
122 blk.13.attn_norm.weight 0xe617bb80 0x4000
123 blk.13.attn_output.weight 0xe617fb80 0x1100000
124 blk.13.attn_q.weight 0xe727fb80 0x1100000
125 blk.13.attn_v.weight 0xe837fb80 0x800000
126 blk.13.ffn_down.weight 0xe8b7fb80 0x3b80000
127 blk.13.ffn_gate.weight 0xec6ffb80 0x3b80000
128 blk.13.ffn_norm.weight 0xf027fb80 0x4000
129 blk.13.ffn_up.weight 0xf0283b80 0x3b80000
130 blk.14.attn_k.weight 0xf3e03b80 0x440000
131 blk.14.attn_norm.weight 0xf4243b80 0x4000
132 blk.14.attn_output.weight 0xf4247b80 0x1100000
133 blk.14.attn_q.weight 0xf5347b80 0x1100000
134 blk.14.attn_v.weight 0xf6447b80 0x800000
135 blk.14.ffn_down.weight 0xf6c47b80 0x3b80000
136 blk.14.ffn_gate.weight 0xfa7c7b80 0x3b80000
137 blk.14.ffn_norm.weight 0xfe347b80 0x4000
138 blk.14.ffn_up.weight 0xfe34bb80 0x3b80000
139 blk.15.attn_k.weight 0x101ecbb80 0x440000
140 blk.15.attn_norm.weight 0x10230bb80 0x4000
141 blk.15.attn_output.weight 0x10230fb80 0x1100000
142 blk.15.attn_q.weight 0x10340fb80 0x1100000
143 blk.15.attn_v.weight 0x10450fb80 0x800000
144 blk.15.ffn_down.weight 0x104d0fb80 0x3b80000
145 blk.15.ffn_gate.weight 0x10888fb80 0x3b80000
146 blk.15.ffn_norm.weight 0x10c40fb80 0x4000
147 blk.15.ffn_up.weight 0x10c413b80 0x3b80000
148 blk.16.attn_k.weight 0x10ff93b80 0x348000
149 blk.16.attn_norm.weight 0x1102dbb80 0x4000
150 blk.16.attn_output.weight 0x1102dfb80 0x1100000
151 blk.16.attn_q.weight 0x1113dfb80 0xd20000
152 blk.16.attn_v.weight 0x1120ffb80 0x440000
153 blk.16.ffn_down.weight 0x11253fb80 0x3b80000
154 blk.16.ffn_gate.weight 0x1160bfb80 0x2df0000
155 blk.16.ffn_norm.weight 0x118eafb80 0x4000
156 blk.16.ffn_up.weight 0x118eb3b80 0x2df0000
157 blk.17.attn_k.weight 0x11bca3b80 0x348000
158 blk.17.attn_norm.weight 0x11bfebb80 0x4000
159 blk.17.attn_output.weight 0x11bfefb80 0x1100000
160 blk.17.attn_q.weight 0x11d0efb80 0xd20000
161 blk.17.attn_v.weight 0x11de0fb80 0x440000
162 blk.17.ffn_down.weight 0x11e24fb80 0x3b80000
163 blk.17.ffn_gate.weight 0x121dcfb80 0x2df0000
164 blk.17.ffn_norm.weight 0x124bbfb80 0x4000
165 blk.17.ffn_up.weight 0x124bc3b80 0x2df0000
166 blk.18.attn_k.weight 0x1279b3b80 0x348000
167 blk.18.attn_norm.weight 0x127cfbb80 0x4000
168 blk.18.attn_output.weight 0x127cffb80 0x1100000
169 blk.18.attn_q.weight 0x128dffb80 0xd20000
170 blk.18.attn_v.weight 0x129b1fb80 0x440000
171 blk.18.ffn_down.weight 0x129f5fb80 0x3b80000
172 blk.18.ffn_gate.weight 0x12dadfb80 0x2df0000
173 blk.18.ffn_norm.weight 0x1308cfb80 0x4000
174 blk.18.ffn_up.weight 0x1308d3b80 0x2df0000
175 blk.19.attn_k.weight 0x1336c3b80 0x348000
176 blk.19.attn_norm.weight 0x133a0bb80 0x4000
177 blk.19.attn_output.weight 0x133a0fb80 0x1100000
178 blk.19.attn_q.weight 0x134b0fb80 0xd20000
179 blk.19.attn_v.weight 0x13582fb80 0x440000
180 blk.19.ffn_down.weight 0x135c6fb80 0x3b80000
181 blk.19.ffn_gate.weight 0x1397efb80 0x2df0000
182 blk.19.ffn_norm.weight 0x13c5dfb80 0x4000
183 blk.19.ffn_up.weight 0x13c5e3b80 0x2df0000
184 blk.20.attn_k.weight 0x13f3d3b80 0x348000
185 blk.20.attn_norm.weight 0x13f71bb80 0x4000
186 blk.20.attn_output.weight 0x13f71fb80 0x1100000
187 blk.20.attn_q.weight 0x14081fb80 0xd20000
188 blk.20.attn_v.weight 0x14153fb80 0x440000
189 blk.20.ffn_down.weight 0x14197fb80 0x3b80000
190 blk.20.ffn_gate.weight 0x1454ffb80 0x2df0000
191 blk.20.ffn_norm.weight 0x1482efb80 0x4000
192 blk.20.ffn_up.weight 0x1482f3b80 0x2df0000
193 blk.21.attn_k.weight 0x14b0e3b80 0x348000
194 blk.21.attn_norm.weight 0x14b42bb80 0x4000
195 blk.21.attn_output.weight 0x14b42fb80 0x1100000
196 blk.21.attn_q.weight 0x14c52fb80 0xd20000
197 blk.21.attn_v.weight 0x14d24fb80 0x440000
198 blk.21.ffn_down.weight 0x14d68fb80 0x3b80000
199 blk.21.ffn_gate.weight 0x15120fb80 0x2df0000
200 blk.21.ffn_norm.weight 0x153fffb80 0x4000
201 blk.21.ffn_up.weight 0x154003b80 0x2df0000
202 blk.22.attn_k.weight 0x156df3b80 0x348000
203 blk.22.attn_norm.weight 0x15713bb80 0x4000
204 blk.22.attn_output.weight 0x15713fb80 0x1100000
205 blk.22.attn_q.weight 0x15823fb80 0xd20000
206 blk.22.attn_v.weight 0x158f5fb80 0x440000
207 blk.22.ffn_down.weight 0x15939fb80 0x3b80000
208 blk.22.ffn_gate.weight 0x15cf1fb80 0x2df0000
209 blk.22.ffn_norm.weight 0x15fd0fb80 0x4000
210 blk.22.ffn_up.weight 0x15fd13b80 0x2df0000
211 blk.23.attn_k.weight 0x162b03b80 0x348000
212 blk.23.attn_norm.weight 0x162e4bb80 0x4000
213 blk.23.attn_output.weight 0x162e4fb80 0x1100000
214 blk.23.attn_q.weight 0x163f4fb80 0xd20000
215 blk.23.attn_v.weight 0x164c6fb80 0x440000
216 blk.23.ffn_down.weight 0x1650afb80 0x3b80000
217 blk.23.ffn_gate.weight 0x168c2fb80 0x2df0000
218 blk.23.ffn_norm.weight 0x16ba1fb80 0x4000
219 blk.23.ffn_up.weight 0x16ba23b80 0x2df0000
220 blk.24.attn_k.weight 0x16e813b80 0x348000
221 blk.24.attn_norm.weight 0x16eb5bb80 0x4000
222 blk.24.attn_output.weight 0x16eb5fb80 0x1100000
223 blk.24.attn_q.weight 0x16fc5fb80 0xd20000
224 blk.24.attn_v.weight 0x17097fb80 0x440000
225 blk.24.ffn_down.weight 0x170dbfb80 0x3b80000
226 blk.24.ffn_gate.weight 0x17493fb80 0x2df0000
227 blk.24.ffn_norm.weight 0x17772fb80 0x4000
228 blk.24.ffn_up.weight 0x177733b80 0x2df0000
229 blk.25.attn_k.weight 0x17a523b80 0x348000
230 blk.25.attn_norm.weight 0x17a86bb80 0x4000
231 blk.25.attn_output.weight 0x17a86fb80 0x1100000
232 blk.25.attn_q.weight 0x17b96fb80 0xd20000
233 blk.25.attn_v.weight 0x17c68fb80 0x440000
234 blk.25.ffn_down.weight 0x17cacfb80 0x3b80000
235 blk.25.ffn_gate.weight 0x18064fb80 0x2df0000
236 blk.25.ffn_norm.weight 0x18343fb80 0x4000
237 blk.25.ffn_up.weight 0x183443b80 0x2df0000
238 blk.26.attn_k.weight 0x186233b80 0x348000
239 blk.26.attn_norm.weight 0x18657bb80 0x4000
240 blk.26.attn_output.weight 0x18657fb80 0x1100000
241 blk.26.attn_q.weight 0x18767fb80 0xd20000
242 blk.26.attn_v.weight 0x18839fb80 0x440000
243 blk.26.ffn_down.weight 0x1887dfb80 0x3b80000
244 blk.26.ffn_gate.weight 0x18c35fb80 0x2df0000
245 blk.26.ffn_norm.weight 0x18f14fb80 0x4000
246 blk.26.ffn_up.weight 0x18f153b80 0x2df0000
247 blk.27.attn_k.weight 0x191f43b80 0x348000
248 blk.27.attn_norm.weight 0x19228bb80 0x4000
249 blk.27.attn_output.weight 0x19228fb80 0x1100000
250 blk.27.attn_q.weight 0x19338fb80 0xd20000
251 blk.27.attn_v.weight 0x1940afb80 0x440000
252 blk.27.ffn_down.weight 0x1944efb80 0x3b80000
253 blk.27.ffn_gate.weight 0x19806fb80 0x2df0000
254 blk.27.ffn_norm.weight 0x19ae5fb80 0x4000
255 blk.27.ffn_up.weight 0x19ae63b80 0x2df0000
256 blk.28.attn_k.weight 0x19dc53b80 0x348000
257 blk.28.attn_norm.weight 0x19df9bb80 0x4000
258 blk.28.attn_output.weight 0x19df9fb80 0x1100000
259 blk.28.attn_q.weight 0x19f09fb80 0xd20000
260 blk.28.attn_v.weight 0x19fdbfb80 0x440000
261 blk.28.ffn_down.weight 0x1a01ffb80 0x3b80000
262 blk.28.ffn_gate.weight 0x1a3d7fb80 0x2df0000
263 blk.28.ffn_norm.weight 0x1a6b6fb80 0x4000
264 blk.28.ffn_up.weight 0x1a6b73b80 0x2df0000
265 blk.29.attn_k.weight 0x1a9963b80 0x348000
266 blk.29.attn_norm.weight 0x1a9cabb80 0x4000
267 blk.29.attn_output.weight 0x1a9cafb80 0x1100000
268 blk.29.attn_q.weight 0x1aadafb80 0xd20000
269 blk.29.attn_v.weight 0x1abacfb80 0x440000
270 blk.29.ffn_down.weight 0x1abf0fb80 0x3b80000
271 blk.29.ffn_gate.weight 0x1afa8fb80 0x2df0000
272 blk.29.ffn_norm.weight 0x1b287fb80 0x4000
273 blk.29.ffn_up.weight 0x1b2883b80 0x2df0000
274 blk.30.attn_k.weight 0x1b5673b80 0x348000
275 blk.30.attn_norm.weight 0x1b59bbb80 0x4000
276 blk.30.attn_output.weight 0x1b59bfb80 0x1100000
277 blk.30.attn_q.weight 0x1b6abfb80 0xd20000
278 blk.30.attn_v.weight 0x1b77dfb80 0x440000
279 blk.30.ffn_down.weight 0x1b7c1fb80 0x3b80000
280 blk.30.ffn_gate.weight 0x1bb79fb80 0x2df0000
281 blk.30.ffn_norm.weight 0x1be58fb80 0x4000
282 blk.30.ffn_up.weight 0x1be593b80 0x2df0000
283 blk.31.attn_k.weight 0x1c1383b80 0x348000
284 blk.31.attn_norm.weight 0x1c16cbb80 0x4000
285 blk.31.attn_output.weight 0x1c16cfb80 0x1100000
286 blk.31.attn_q.weight 0x1c27cfb80 0xd20000
287 blk.31.attn_v.weight 0x1c34efb80 0x440000
288 blk.31.ffn_down.weight 0x1c392fb80 0x3b80000
289 blk.31.ffn_gate.weight 0x1c74afb80 0x2df0000
290 blk.31.ffn_norm.weight 0x1ca29fb80 0x4000
291 blk.31.ffn_up.weight 0x1ca2a3b80 0x2df0000

Base Tensor Group : ~1B Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
0 output.weight Output (W) (~525M) 525336576 4096 x 128256 x 1 x 1 Q8_0
1 output_norm.weight Output Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
2 rope_freqs.weight Rope_Freqs (W) ( 64) 64 64 x 1 x 1 x 1 F32
3 token_embd.weight Token Embedding (W) (~525M) 525336576 4096 x 128256 x 1 x 1 Q3_K
  • Total elements in base: ( ~1B) 1050677312
  • Percentage of total elements: 13.08%

Block 0 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
4 blk.0.attn_k.weight Block 0 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
5 blk.0.attn_norm.weight Block 0 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
6 blk.0.attn_output.weight Block 0 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
7 blk.0.attn_q.weight Block 0 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
8 blk.0.attn_v.weight Block 0 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
9 blk.0.ffn_down.weight Block 0 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
10 blk.0.ffn_gate.weight Block 0 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
11 blk.0.ffn_norm.weight Block 0 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
12 blk.0.ffn_up.weight Block 0 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.0: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 1 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
13 blk.1.attn_k.weight Block 1 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
14 blk.1.attn_norm.weight Block 1 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
15 blk.1.attn_output.weight Block 1 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
16 blk.1.attn_q.weight Block 1 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
17 blk.1.attn_v.weight Block 1 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
18 blk.1.ffn_down.weight Block 1 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
19 blk.1.ffn_gate.weight Block 1 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
20 blk.1.ffn_norm.weight Block 1 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
21 blk.1.ffn_up.weight Block 1 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.1: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 2 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
22 blk.2.attn_k.weight Block 2 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
23 blk.2.attn_norm.weight Block 2 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
24 blk.2.attn_output.weight Block 2 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
25 blk.2.attn_q.weight Block 2 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
26 blk.2.attn_v.weight Block 2 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
27 blk.2.ffn_down.weight Block 2 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
28 blk.2.ffn_gate.weight Block 2 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
29 blk.2.ffn_norm.weight Block 2 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
30 blk.2.ffn_up.weight Block 2 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.2: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 3 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
31 blk.3.attn_k.weight Block 3 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
32 blk.3.attn_norm.weight Block 3 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
33 blk.3.attn_output.weight Block 3 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
34 blk.3.attn_q.weight Block 3 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
35 blk.3.attn_v.weight Block 3 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
36 blk.3.ffn_down.weight Block 3 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
37 blk.3.ffn_gate.weight Block 3 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
38 blk.3.ffn_norm.weight Block 3 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
39 blk.3.ffn_up.weight Block 3 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.3: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 4 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
40 blk.4.attn_k.weight Block 4 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
41 blk.4.attn_norm.weight Block 4 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
42 blk.4.attn_output.weight Block 4 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
43 blk.4.attn_q.weight Block 4 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
44 blk.4.attn_v.weight Block 4 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
45 blk.4.ffn_down.weight Block 4 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
46 blk.4.ffn_gate.weight Block 4 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
47 blk.4.ffn_norm.weight Block 4 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
48 blk.4.ffn_up.weight Block 4 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.4: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 5 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
49 blk.5.attn_k.weight Block 5 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
50 blk.5.attn_norm.weight Block 5 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
51 blk.5.attn_output.weight Block 5 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
52 blk.5.attn_q.weight Block 5 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
53 blk.5.attn_v.weight Block 5 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
54 blk.5.ffn_down.weight Block 5 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
55 blk.5.ffn_gate.weight Block 5 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
56 blk.5.ffn_norm.weight Block 5 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
57 blk.5.ffn_up.weight Block 5 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.5: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 6 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
58 blk.6.attn_k.weight Block 6 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
59 blk.6.attn_norm.weight Block 6 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
60 blk.6.attn_output.weight Block 6 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
61 blk.6.attn_q.weight Block 6 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
62 blk.6.attn_v.weight Block 6 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
63 blk.6.ffn_down.weight Block 6 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
64 blk.6.ffn_gate.weight Block 6 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
65 blk.6.ffn_norm.weight Block 6 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
66 blk.6.ffn_up.weight Block 6 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.6: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 7 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
67 blk.7.attn_k.weight Block 7 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
68 blk.7.attn_norm.weight Block 7 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
69 blk.7.attn_output.weight Block 7 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
70 blk.7.attn_q.weight Block 7 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
71 blk.7.attn_v.weight Block 7 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
72 blk.7.ffn_down.weight Block 7 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
73 blk.7.ffn_gate.weight Block 7 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
74 blk.7.ffn_norm.weight Block 7 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
75 blk.7.ffn_up.weight Block 7 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.7: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 8 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
76 blk.8.attn_k.weight Block 8 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
77 blk.8.attn_norm.weight Block 8 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
78 blk.8.attn_output.weight Block 8 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
79 blk.8.attn_q.weight Block 8 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
80 blk.8.attn_v.weight Block 8 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
81 blk.8.ffn_down.weight Block 8 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
82 blk.8.ffn_gate.weight Block 8 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
83 blk.8.ffn_norm.weight Block 8 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
84 blk.8.ffn_up.weight Block 8 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.8: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 9 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
85 blk.9.attn_k.weight Block 9 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
86 blk.9.attn_norm.weight Block 9 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
87 blk.9.attn_output.weight Block 9 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
88 blk.9.attn_q.weight Block 9 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
89 blk.9.attn_v.weight Block 9 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
90 blk.9.ffn_down.weight Block 9 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
91 blk.9.ffn_gate.weight Block 9 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
92 blk.9.ffn_norm.weight Block 9 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
93 blk.9.ffn_up.weight Block 9 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.9: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 10 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
94 blk.10.attn_k.weight Block 10 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
95 blk.10.attn_norm.weight Block 10 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
96 blk.10.attn_output.weight Block 10 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
97 blk.10.attn_q.weight Block 10 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
98 blk.10.attn_v.weight Block 10 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
99 blk.10.ffn_down.weight Block 10 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
100 blk.10.ffn_gate.weight Block 10 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
101 blk.10.ffn_norm.weight Block 10 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
102 blk.10.ffn_up.weight Block 10 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.10: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 11 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
103 blk.11.attn_k.weight Block 11 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
104 blk.11.attn_norm.weight Block 11 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
105 blk.11.attn_output.weight Block 11 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
106 blk.11.attn_q.weight Block 11 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
107 blk.11.attn_v.weight Block 11 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
108 blk.11.ffn_down.weight Block 11 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
109 blk.11.ffn_gate.weight Block 11 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
110 blk.11.ffn_norm.weight Block 11 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
111 blk.11.ffn_up.weight Block 11 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.11: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 12 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
112 blk.12.attn_k.weight Block 12 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
113 blk.12.attn_norm.weight Block 12 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
114 blk.12.attn_output.weight Block 12 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
115 blk.12.attn_q.weight Block 12 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
116 blk.12.attn_v.weight Block 12 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
117 blk.12.ffn_down.weight Block 12 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
118 blk.12.ffn_gate.weight Block 12 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
119 blk.12.ffn_norm.weight Block 12 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
120 blk.12.ffn_up.weight Block 12 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.12: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 13 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
121 blk.13.attn_k.weight Block 13 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
122 blk.13.attn_norm.weight Block 13 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
123 blk.13.attn_output.weight Block 13 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
124 blk.13.attn_q.weight Block 13 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
125 blk.13.attn_v.weight Block 13 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
126 blk.13.ffn_down.weight Block 13 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
127 blk.13.ffn_gate.weight Block 13 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
128 blk.13.ffn_norm.weight Block 13 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
129 blk.13.ffn_up.weight Block 13 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.13: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 14 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
130 blk.14.attn_k.weight Block 14 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
131 blk.14.attn_norm.weight Block 14 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
132 blk.14.attn_output.weight Block 14 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
133 blk.14.attn_q.weight Block 14 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
134 blk.14.attn_v.weight Block 14 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
135 blk.14.ffn_down.weight Block 14 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
136 blk.14.ffn_gate.weight Block 14 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
137 blk.14.ffn_norm.weight Block 14 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
138 blk.14.ffn_up.weight Block 14 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.14: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 15 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
139 blk.15.attn_k.weight Block 15 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
140 blk.15.attn_norm.weight Block 15 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
141 blk.15.attn_output.weight Block 15 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
142 blk.15.attn_q.weight Block 15 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
143 blk.15.attn_v.weight Block 15 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 F16
144 blk.15.ffn_down.weight Block 15 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
145 blk.15.ffn_gate.weight Block 15 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
146 blk.15.ffn_norm.weight Block 15 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
147 blk.15.ffn_up.weight Block 15 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q8_0
  • Total elements in blk.15: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 16 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
148 blk.16.attn_k.weight Block 16 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
149 blk.16.attn_norm.weight Block 16 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
150 blk.16.attn_output.weight Block 16 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
151 blk.16.attn_q.weight Block 16 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
152 blk.16.attn_v.weight Block 16 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
153 blk.16.ffn_down.weight Block 16 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
154 blk.16.ffn_gate.weight Block 16 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
155 blk.16.ffn_norm.weight Block 16 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
156 blk.16.ffn_up.weight Block 16 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.16: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 17 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
157 blk.17.attn_k.weight Block 17 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
158 blk.17.attn_norm.weight Block 17 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
159 blk.17.attn_output.weight Block 17 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
160 blk.17.attn_q.weight Block 17 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
161 blk.17.attn_v.weight Block 17 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
162 blk.17.ffn_down.weight Block 17 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
163 blk.17.ffn_gate.weight Block 17 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
164 blk.17.ffn_norm.weight Block 17 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
165 blk.17.ffn_up.weight Block 17 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.17: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 18 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
166 blk.18.attn_k.weight Block 18 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
167 blk.18.attn_norm.weight Block 18 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
168 blk.18.attn_output.weight Block 18 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
169 blk.18.attn_q.weight Block 18 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
170 blk.18.attn_v.weight Block 18 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
171 blk.18.ffn_down.weight Block 18 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
172 blk.18.ffn_gate.weight Block 18 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
173 blk.18.ffn_norm.weight Block 18 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
174 blk.18.ffn_up.weight Block 18 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.18: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 19 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
175 blk.19.attn_k.weight Block 19 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
176 blk.19.attn_norm.weight Block 19 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
177 blk.19.attn_output.weight Block 19 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
178 blk.19.attn_q.weight Block 19 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
179 blk.19.attn_v.weight Block 19 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
180 blk.19.ffn_down.weight Block 19 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
181 blk.19.ffn_gate.weight Block 19 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
182 blk.19.ffn_norm.weight Block 19 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
183 blk.19.ffn_up.weight Block 19 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.19: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 20 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
184 blk.20.attn_k.weight Block 20 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
185 blk.20.attn_norm.weight Block 20 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
186 blk.20.attn_output.weight Block 20 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
187 blk.20.attn_q.weight Block 20 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
188 blk.20.attn_v.weight Block 20 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
189 blk.20.ffn_down.weight Block 20 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
190 blk.20.ffn_gate.weight Block 20 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
191 blk.20.ffn_norm.weight Block 20 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
192 blk.20.ffn_up.weight Block 20 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.20: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 21 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
193 blk.21.attn_k.weight Block 21 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
194 blk.21.attn_norm.weight Block 21 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
195 blk.21.attn_output.weight Block 21 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
196 blk.21.attn_q.weight Block 21 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
197 blk.21.attn_v.weight Block 21 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
198 blk.21.ffn_down.weight Block 21 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
199 blk.21.ffn_gate.weight Block 21 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
200 blk.21.ffn_norm.weight Block 21 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
201 blk.21.ffn_up.weight Block 21 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.21: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 22 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
202 blk.22.attn_k.weight Block 22 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
203 blk.22.attn_norm.weight Block 22 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
204 blk.22.attn_output.weight Block 22 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
205 blk.22.attn_q.weight Block 22 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
206 blk.22.attn_v.weight Block 22 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
207 blk.22.ffn_down.weight Block 22 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
208 blk.22.ffn_gate.weight Block 22 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
209 blk.22.ffn_norm.weight Block 22 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
210 blk.22.ffn_up.weight Block 22 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.22: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 23 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
211 blk.23.attn_k.weight Block 23 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
212 blk.23.attn_norm.weight Block 23 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
213 blk.23.attn_output.weight Block 23 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
214 blk.23.attn_q.weight Block 23 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
215 blk.23.attn_v.weight Block 23 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
216 blk.23.ffn_down.weight Block 23 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
217 blk.23.ffn_gate.weight Block 23 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
218 blk.23.ffn_norm.weight Block 23 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
219 blk.23.ffn_up.weight Block 23 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.23: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 24 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
220 blk.24.attn_k.weight Block 24 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
221 blk.24.attn_norm.weight Block 24 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
222 blk.24.attn_output.weight Block 24 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
223 blk.24.attn_q.weight Block 24 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
224 blk.24.attn_v.weight Block 24 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
225 blk.24.ffn_down.weight Block 24 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
226 blk.24.ffn_gate.weight Block 24 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
227 blk.24.ffn_norm.weight Block 24 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
228 blk.24.ffn_up.weight Block 24 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.24: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 25 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
229 blk.25.attn_k.weight Block 25 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
230 blk.25.attn_norm.weight Block 25 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
231 blk.25.attn_output.weight Block 25 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
232 blk.25.attn_q.weight Block 25 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
233 blk.25.attn_v.weight Block 25 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
234 blk.25.ffn_down.weight Block 25 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
235 blk.25.ffn_gate.weight Block 25 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
236 blk.25.ffn_norm.weight Block 25 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
237 blk.25.ffn_up.weight Block 25 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.25: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 26 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
238 blk.26.attn_k.weight Block 26 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
239 blk.26.attn_norm.weight Block 26 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
240 blk.26.attn_output.weight Block 26 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
241 blk.26.attn_q.weight Block 26 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
242 blk.26.attn_v.weight Block 26 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
243 blk.26.ffn_down.weight Block 26 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
244 blk.26.ffn_gate.weight Block 26 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
245 blk.26.ffn_norm.weight Block 26 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
246 blk.26.ffn_up.weight Block 26 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.26: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 27 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
247 blk.27.attn_k.weight Block 27 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
248 blk.27.attn_norm.weight Block 27 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
249 blk.27.attn_output.weight Block 27 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
250 blk.27.attn_q.weight Block 27 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
251 blk.27.attn_v.weight Block 27 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
252 blk.27.ffn_down.weight Block 27 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
253 blk.27.ffn_gate.weight Block 27 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
254 blk.27.ffn_norm.weight Block 27 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
255 blk.27.ffn_up.weight Block 27 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.27: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 28 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
256 blk.28.attn_k.weight Block 28 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
257 blk.28.attn_norm.weight Block 28 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
258 blk.28.attn_output.weight Block 28 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
259 blk.28.attn_q.weight Block 28 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
260 blk.28.attn_v.weight Block 28 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
261 blk.28.ffn_down.weight Block 28 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
262 blk.28.ffn_gate.weight Block 28 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
263 blk.28.ffn_norm.weight Block 28 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
264 blk.28.ffn_up.weight Block 28 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.28: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 29 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
265 blk.29.attn_k.weight Block 29 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
266 blk.29.attn_norm.weight Block 29 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
267 blk.29.attn_output.weight Block 29 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
268 blk.29.attn_q.weight Block 29 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
269 blk.29.attn_v.weight Block 29 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
270 blk.29.ffn_down.weight Block 29 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
271 blk.29.ffn_gate.weight Block 29 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
272 blk.29.ffn_norm.weight Block 29 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
273 blk.29.ffn_up.weight Block 29 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.29: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 30 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
274 blk.30.attn_k.weight Block 30 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
275 blk.30.attn_norm.weight Block 30 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
276 blk.30.attn_output.weight Block 30 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
277 blk.30.attn_q.weight Block 30 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
278 blk.30.attn_v.weight Block 30 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
279 blk.30.ffn_down.weight Block 30 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
280 blk.30.ffn_gate.weight Block 30 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
281 blk.30.ffn_norm.weight Block 30 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
282 blk.30.ffn_up.weight Block 30 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.30: (~218M) 218112000
  • Percentage of total elements: 2.72%

Block 31 Tensor Group : ~218M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type
283 blk.31.attn_k.weight Block 31 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q6_K
284 blk.31.attn_norm.weight Block 31 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
285 blk.31.attn_output.weight Block 31 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0
286 blk.31.attn_q.weight Block 31 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K
287 blk.31.attn_v.weight Block 31 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0
288 blk.31.ffn_down.weight Block 31 Feed-Forward Network "Down" (W) (~59M) 58720256 14336 x 4096 x 1 x 1 Q8_0
289 blk.31.ffn_gate.weight Block 31 Feed-Forward Network "Gate" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
290 blk.31.ffn_norm.weight Block 31 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32
291 blk.31.ffn_up.weight Block 31 Feed-Forward Network "Up" (W) (~59M) 58720256 4096 x 14336 x 1 x 1 Q6_K
  • Total elements in blk.31: (~218M) 218112000
  • Percentage of total elements: 2.72%