Files changed (1) hide show
  1. README.md +64 -51
README.md CHANGED
@@ -1,51 +1,64 @@
1
- ---
2
- base_model:
3
- - VAGOsolutions/SauerkrautLM-v2-14b-SFT
4
- - rombodawg/Rombos-LLM-V2.6-Qwen-14b
5
- - Qwen/Qwen2.5-14B
6
- - huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
7
- - arcee-ai/SuperNova-Medius
8
- - arcee-ai/Virtuoso-Small
9
- library_name: transformers
10
- tags:
11
- - mergekit
12
- - merge
13
-
14
- ---
15
- # merge
16
-
17
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
-
19
- ## Merge Details
20
- ### Merge Method
21
-
22
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) as a base.
23
-
24
- ### Models Merged
25
-
26
- The following models were included in the merge:
27
- * [VAGOsolutions/SauerkrautLM-v2-14b-SFT](https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT)
28
- * [rombodawg/Rombos-LLM-V2.6-Qwen-14b](https://huggingface.co/rombodawg/Rombos-LLM-V2.6-Qwen-14b)
29
- * [huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2](https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2)
30
- * [arcee-ai/SuperNova-Medius](https://huggingface.co/arcee-ai/SuperNova-Medius)
31
- * [arcee-ai/Virtuoso-Small](https://huggingface.co/arcee-ai/Virtuoso-Small)
32
-
33
- ### Configuration
34
-
35
- The following YAML configuration was used to produce this model:
36
-
37
- ```yaml
38
- models:
39
- - model: Qwen/Qwen2.5-14B
40
- - model: arcee-ai/Virtuoso-Small
41
- - model: arcee-ai/SuperNova-Medius
42
- - model: rombodawg/Rombos-LLM-V2.6-Qwen-14b
43
- - model: VAGOsolutions/SauerkrautLM-v2-14b-SFT
44
- - model: huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
45
- base_model: Qwen/Qwen2.5-14B
46
- merge_method: model_stock
47
- parameters:
48
- normalize: true
49
- dtype: bfloat16
50
-
51
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - VAGOsolutions/SauerkrautLM-v2-14b-SFT
4
+ - rombodawg/Rombos-LLM-V2.6-Qwen-14b
5
+ - Qwen/Qwen2.5-14B
6
+ - huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
7
+ - arcee-ai/SuperNova-Medius
8
+ - arcee-ai/Virtuoso-Small
9
+ library_name: transformers
10
+ tags:
11
+ - mergekit
12
+ - merge
13
+ language:
14
+ - zho
15
+ - eng
16
+ - fra
17
+ - spa
18
+ - por
19
+ - deu
20
+ - ita
21
+ - rus
22
+ - jpn
23
+ - kor
24
+ - vie
25
+ - tha
26
+ - ara
27
+ ---
28
+ # merge
29
+
30
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
31
+
32
+ ## Merge Details
33
+ ### Merge Method
34
+
35
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) as a base.
36
+
37
+ ### Models Merged
38
+
39
+ The following models were included in the merge:
40
+ * [VAGOsolutions/SauerkrautLM-v2-14b-SFT](https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT)
41
+ * [rombodawg/Rombos-LLM-V2.6-Qwen-14b](https://huggingface.co/rombodawg/Rombos-LLM-V2.6-Qwen-14b)
42
+ * [huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2](https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2)
43
+ * [arcee-ai/SuperNova-Medius](https://huggingface.co/arcee-ai/SuperNova-Medius)
44
+ * [arcee-ai/Virtuoso-Small](https://huggingface.co/arcee-ai/Virtuoso-Small)
45
+
46
+ ### Configuration
47
+
48
+ The following YAML configuration was used to produce this model:
49
+
50
+ ```yaml
51
+ models:
52
+ - model: Qwen/Qwen2.5-14B
53
+ - model: arcee-ai/Virtuoso-Small
54
+ - model: arcee-ai/SuperNova-Medius
55
+ - model: rombodawg/Rombos-LLM-V2.6-Qwen-14b
56
+ - model: VAGOsolutions/SauerkrautLM-v2-14b-SFT
57
+ - model: huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
58
+ base_model: Qwen/Qwen2.5-14B
59
+ merge_method: model_stock
60
+ parameters:
61
+ normalize: true
62
+ dtype: bfloat16
63
+
64
+ ```