Vortex5 commited on
Commit
e377594
·
verified ·
1 Parent(s): 4c8f741

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +241 -15
README.md CHANGED
@@ -7,29 +7,223 @@ library_name: transformers
7
  tags:
8
  - mergekit
9
  - merge
10
-
11
  ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- ## Merge Details
17
- ### Merge Method
18
 
19
- This model was merged using the flowforge merge method using [Vortex5/LunaMaid-12B](https://huggingface.co/Vortex5/LunaMaid-12B) as a base.
 
 
 
 
 
 
 
 
20
 
21
- ### Models Merged
 
 
 
 
22
 
23
- The following models were included in the merge:
24
- * [Vortex5/Crimson-Twilight-12B](https://huggingface.co/Vortex5/Crimson-Twilight-12B)
25
- * [Vortex5/Harmony-Bird-12B](https://huggingface.co/Vortex5/Harmony-Bird-12B)
 
 
 
26
 
27
- ### Configuration
 
28
 
29
- The following YAML configuration was used to produce this model:
 
 
 
 
30
 
31
- ```yaml
 
 
 
 
32
 
 
 
 
33
  merge_method: flowforge
34
  models:
35
  - model: Vortex5/Crimson-Twilight-12B
@@ -41,5 +235,37 @@ parameters:
41
  dtype: bfloat16
42
  tokenizer:
43
  source: Vortex5/LunaMaid-12B
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  tags:
8
  - mergekit
9
  - merge
10
+ - roleplay
11
  ---
12
+ <html lang="en">
13
+ <head>
14
+ <meta charset="UTF-8">
15
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
16
+ <title>Scarlet-Eclipse — 12B</title>
17
+ <link href="https://fonts.googleapis.com/css2?family=Cinzel+Decorative&family=Cinzel:wght@400;600&family=Orbitron:wght@400;600;700&family=JetBrains+Mono:wght@300;400;700&display=swap" rel="stylesheet">
18
+ <style>
19
+ body {
20
+ background: radial-gradient(circle at top left, #090000 0%, #000000 90%);
21
+ color: #f0e6e6;
22
+ font-family: 'JetBrains Mono', monospace;
23
+ margin: 0;
24
+ line-height: 1.6;
25
+ overflow-x: hidden;
26
+ }
27
+ /* Background grid */
28
+ .cyber-grid-bg {
29
+ position: fixed;
30
+ top: 0; left: 0; right: 0; bottom: 0;
31
+ background-image:
32
+ linear-gradient(rgba(180,40,40,0.04) 1px, transparent 1px),
33
+ linear-gradient(90deg, rgba(180,40,40,0.04) 1px, transparent 1px);
34
+ background-size: 22px 22px;
35
+ z-index: -1;
36
+ }
37
+ /* Outer frame */
38
+ .container {
39
+ max-width: 1200px;
40
+ margin: 70px auto;
41
+ padding: 60px 70px;
42
+ background: radial-gradient(circle at 40% 60%, rgba(15,0,0,0.9) 0%, rgba(0,0,0,0.96) 100%);
43
+ border-radius: 22px;
44
+ border: 3px double rgba(160,0,0,0.6);
45
+ box-shadow:
46
+ 0 0 60px rgba(255,40,40,0.25),
47
+ inset 0 0 60px rgba(160,0,0,0.3),
48
+ 0 0 0 3px rgba(255,200,200,0.05);
49
+ position: relative;
50
+ overflow: hidden;
51
+ }
52
+ /* Top ambient glow */
53
+ .container::before {
54
+ content: "";
55
+ position: absolute;
56
+ top: -180px; left: 50%;
57
+ transform: translateX(-50%);
58
+ width: 700px; height: 700px;
59
+ background: radial-gradient(circle, rgba(255,0,0,0.18) 0%, transparent 70%);
60
+ filter: blur(90px);
61
+ z-index: 0;
62
+ }
63
+ /* Title block */
64
+ .title-container {
65
+ border-left: 4px solid #c32a2a;
66
+ background: rgba(30,0,0,0.75);
67
+ padding: 30px 45px;
68
+ margin-bottom: 50px;
69
+ position: relative;
70
+ box-shadow: 0 0 30px rgba(150,0,0,0.25);
71
+ }
72
+ .title-container::after {
73
+ content: "";
74
+ position: absolute;
75
+ bottom: 0; left: 0;
76
+ width: 100%; height: 2px;
77
+ background: linear-gradient(90deg, transparent, rgba(255,80,80,0.8), transparent);
78
+ }
79
+ .title-main {
80
+ font-family: 'Cinzel Decorative', serif;
81
+ font-size: 3.2rem;
82
+ color: #ff4e4e;
83
+ text-transform: uppercase;
84
+ text-shadow:
85
+ 0 0 20px rgba(255,0,0,0.7),
86
+ 0 0 45px rgba(255,120,120,0.4);
87
+ margin: 0;
88
+ }
89
+ .title-sub {
90
+ font-family: 'Orbitron', sans-serif;
91
+ color: #ffb3a0;
92
+ font-size: 1.2rem;
93
+ letter-spacing: 3px;
94
+ text-transform: uppercase;
95
+ margin-top: 6px;
96
+ }
97
+ .quote {
98
+ font-family: 'Cinzel', serif;
99
+ color: #ffbaba;
100
+ font-style: italic;
101
+ margin-top: 18px;
102
+ text-shadow: 0 0 12px rgba(255,60,60,0.35);
103
+ }
104
+ /* Sections */
105
+ .section {
106
+ background: rgba(20,0,0,0.9);
107
+ border-left: 4px solid #c32a2a;
108
+ border-radius: 8px;
109
+ margin-bottom: 45px;
110
+ box-shadow: 0 0 25px rgba(255,0,0,0.15);
111
+ }
112
+ .section-header {
113
+ display: flex;
114
+ align-items: center;
115
+ background: rgba(255,80,80,0.08);
116
+ padding: 12px 25px;
117
+ border-bottom: 1px solid rgba(255,100,100,0.3);
118
+ }
119
+ .section-indicator {
120
+ width: 8px; height: 20px;
121
+ background-color: #ff4e4e;
122
+ margin-right: 15px;
123
+ }
124
+ .section-title {
125
+ font-family: 'Orbitron', sans-serif;
126
+ color: #f0e6e6;
127
+ font-size: 1.25rem;
128
+ text-transform: uppercase;
129
+ letter-spacing: 2px;
130
+ }
131
+ .section-content {
132
+ padding: 25px 30px;
133
+ font-size: 1.05rem;
134
+ color: #ffecec;
135
+ }
136
+ /* Details & code block */
137
+ details {
138
+ background: rgba(50,0,0,0.45);
139
+ border-left: 4px solid #ff4e4e;
140
+ border-radius: 8px;
141
+ padding: 15px 25px;
142
+ margin-top: 15px;
143
+ transition: all 0.3s ease;
144
+ cursor: pointer;
145
+ }
146
+ details:hover {
147
+ box-shadow: 0 0 25px rgba(255,40,40,0.35), inset 0 0 20px rgba(100,0,0,0.3);
148
+ }
149
+ summary {
150
+ font-family: 'Cinzel', serif;
151
+ color: #ff7e7e;
152
+ font-size: 1.05rem;
153
+ font-weight: 600;
154
+ }
155
+ pre {
156
+ background: rgba(15,0,0,0.9);
157
+ color: #ffeaea;
158
+ padding: 20px 25px;
159
+ border-left: 4px solid #ff4e4e;
160
+ border-radius: 8px;
161
+ overflow-x: auto;
162
+ }
163
+ a { color: #ff7e7e; text-decoration: none; }
164
+ a:hover { color: #fff; text-shadow: 0 0 12px rgba(255,120,120,0.9); }
165
+ img {
166
+ display:block;
167
+ margin:0 auto 50px;
168
+ border-radius:14px;
169
+ max-width:92%;
170
+ box-shadow:
171
+ 0 0 35px rgba(255,60,60,0.4),
172
+ 0 0 70px rgba(120,0,0,0.3),
173
+ inset 0 0 10px rgba(255,100,100,0.2);
174
+ }
175
+ </style>
176
+ </head>
177
+ <body>
178
+ <div class="cyber-grid-bg"></div>
179
+ <div class="container">
180
+ <div class="title-container">
181
+ <h1 class="title-main">Scarlet Eclipse — 12B</h1>
182
+ </div>
183
 
184
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/zn5RZrMkNQRwy_F3MLPPW.png" alt="Scarlet-Eclipse-12B"/>
 
185
 
186
+ <div class="section">
187
+ <div class="section-header">
188
+ <div class="section-indicator"></div>
189
+ <h2 class="section-title">01 // OVERVIEW</h2>
190
+ </div>
191
+ <div class="section-content">
192
+ <p><b>Scarlet-Eclipse-12B</b> is a model merged using a custom method — it merges <a href="https://huggingface.co/Vortex5/Crimson-Twilight-12B">Vortex5/Crimson-Twilight-12B</a> and <a href="https://huggingface.co/Vortex5/Harmony-Bird-12B">Vortex5/Harmony-Bird-12B</a>, with <a href="https://huggingface.co/Vortex5/LunaMaid-12B">Vortex5/LunaMaid-12B</a> as a base.</p>
193
+ </div>
194
+ </div>
195
 
196
+ <div class="section">
197
+ <div class="section-header">
198
+ <div class="section-indicator"></div>
199
+ <h2 class="section-title">02 // MERGE CONFIGURATION</h2>
200
+ </div>
201
 
202
+ <div class="section-content">
203
+ <div class="pane">
204
+ <h3 class="pane-title silver-glow"
205
+ style="font-size:1.5rem; font-weight:700; letter-spacing:2px; margin-bottom:12px;">
206
+ Custom Merge Method:<span class="underline"></span>
207
+ </h3>
208
 
209
+ <details class="expando">
210
+ <summary>Read full explanation</summary>
211
 
212
+ <p style="margin-top:10px;">
213
+ It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging
214
+ them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and
215
+ scales these offsets to preserve numerical stability.
216
+ </p>
217
 
218
+ <p>
219
+ A small orthogonal adjustment prevents collapse when donors are highly similar, while the strength, trust, and top_k parameters control how far and how selectively
220
+ the merge travels through parameter space.
221
+ The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.
222
+ </p>
223
 
224
+ <details class="expando nested">
225
+ <summary>Show YAML</summary>
226
+ <pre class="codeblock"><code>
227
  merge_method: flowforge
228
  models:
229
  - model: Vortex5/Crimson-Twilight-12B
 
235
  dtype: bfloat16
236
  tokenizer:
237
  source: Vortex5/LunaMaid-12B
238
+ </code></pre>
239
+ </details>
240
+ </details>
241
+ </div>
242
+ </div>
243
+ </div>
244
+
245
+
246
+ <div class="section">
247
+ <div class="section-header">
248
+ <div class="section-indicator"></div>
249
+ <h2 class="section-title">03 // INTENDED USE</h2>
250
+ </div>
251
+ <div class="section-content">
252
+ 🖋️ Storytelling • 🌒 Roleplay • 🔥 For deeper, evocative scenes
253
+ </div>
254
+ </div>
255
 
256
+ <div class="section">
257
+ <div class="section-header">
258
+ <div class="section-indicator"></div>
259
+ <h2 class="section-title">04 // CREDITS</h2>
260
+ </div>
261
+ <div class="section-content">
262
+ <ul style="list-style:none;padding-left:10px;margin:0;">
263
+ <li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
264
+ <li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
265
+ <li><strong><a>Original creators and model authors</a></strong></li>
266
+ </ul>
267
+ </div>
268
+ </div>
269
+ </div>
270
+ </body>
271
+ </html>