Aratako commited on
Commit
fa667c7
·
1 Parent(s): 2dc1a34

model upload

Browse files
Files changed (1) hide show
  1. README.md +38 -1
README.md CHANGED
@@ -1,3 +1,40 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
  ---
9
+ # Ninja-Antler-RP
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using ./Ninja-v1-RP as a base.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * ./Antler-7B-MS
22
+
23
+ ### Configuration
24
+
25
+ The following YAML configuration was used to produce this model:
26
+
27
+ ```yaml
28
+ models:
29
+ - model: ./Ninja-v1-RP
30
+ # no parameters necessary for base model
31
+ - model: ./Antler-7B-MS # follow user intent
32
+ parameters:
33
+ density: 0.7
34
+ weight: 0.5
35
+ merge_method: dare_ties
36
+ base_model: ./Ninja-v1-RP
37
+ dtype: bfloat16
38
+ tokenizer_source: union
39
+
40
+ ```