TroyDoesAI commited on
Commit
0b352cd
·
verified ·
1 Parent(s): f884182

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -43
README.md CHANGED
@@ -1,43 +1,43 @@
1
- ---
2
- base_model:
3
- - TroyDoesAI/Contextual-Llama-13B-RAG
4
- library_name: transformers
5
- tags:
6
- - mergekit
7
- - merge
8
-
9
- ---
10
- # Mighty-Llama-RAG
11
-
12
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
-
14
- ## Merge Details
15
- ### Merge Method
16
-
17
- This model was merged using the passthrough merge method.
18
-
19
- ### Models Merged
20
-
21
- The following models were included in the merge:
22
- * [TroyDoesAI/Contextual-Llama-13B-RAG](https://huggingface.co/TroyDoesAI/Contextual-Llama-13B-RAG)
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- slices:
30
- - sources:
31
- - model: TroyDoesAI/Contextual-Llama-13B-RAG
32
- layer_range: [0, 24]
33
- - sources:
34
- - model: TroyDoesAI/Contextual-Llama-13B-RAG
35
- layer_range: [18, 36]
36
- - sources:
37
- - model: TroyDoesAI/Contextual-Llama-13B-RAG
38
- layer_range: [24, 40]
39
-
40
- merge_method: passthrough
41
- dtype: float16
42
-
43
- ```
 
1
+ ---
2
+ base_model:
3
+ - TroyDoesAI/Contextual-Llama-13B-RAG
4
+ library_name: transformers
5
+ tags:
6
+ - mergekit
7
+ - merge
8
+
9
+ ---
10
+ # Mighty-Llama-RAG
11
+
12
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
+
14
+ ## Merge Details
15
+ ### Merge Method
16
+
17
+ This model was merged using the passthrough merge method.
18
+
19
+ ### Models Merged
20
+
21
+ The following models were included in the merge:
22
+ * [TroyDoesAI/Contextual-Llama-13B-RAG](https://huggingface.co/TroyDoesAI/Contextual-Llama-13B-RAG)
23
+
24
+ ### Configuration
25
+
26
+ The following YAML configuration was used to produce this model:
27
+
28
+ ```yaml
29
+ slices:
30
+ - sources:
31
+ - model: TroyDoesAI/Contextual-Llama-13B-RAG
32
+ layer_range: [0, 24]
33
+ - sources:
34
+ - model: cognitivecomputations/Samantha-1.11-13b
35
+ layer_range: [18, 36]
36
+ - sources:
37
+ - model: TroyDoesAI/Contextual-Llama-13B-RAG
38
+ layer_range: [24, 40]
39
+
40
+ merge_method: passthrough
41
+ dtype: float16
42
+
43
+ ```