Delta-Vector commited on
Commit
e994a9b
·
verified ·
1 Parent(s): cee94b7

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Delta-Vector/Rei-12B
4
+ - Delta-Vector/Francois-Huali-12B
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ ### exl2 quant (measurement.json in main branch)
12
+ ---
13
+ ### check revisions for quants
14
+ ---
15
+
16
+ # merge
17
+
18
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
+
20
+ ## Merge Details
21
+ ### Merge Method
22
+
23
+ This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
24
+
25
+ ### Models Merged
26
+
27
+ The following models were included in the merge:
28
+ * [Delta-Vector/Rei-12B](https://huggingface.co/Delta-Vector/Rei-12B)
29
+ * [Delta-Vector/Francois-Huali-12B](https://huggingface.co/Delta-Vector/Francois-Huali-12B)
30
+
31
+ ### Configuration
32
+
33
+ The following YAML configuration was used to produce this model:
34
+
35
+ ```yaml
36
+ models:
37
+ - model: Delta-Vector/Francois-Huali-12B
38
+ - model: Delta-Vector/Rei-12B
39
+ merge_method: slerp
40
+ base_model: Delta-Vector/Rei-12B
41
+ parameters:
42
+ t:
43
+ - value: 0.2
44
+ dtype: bfloat16
45
+ tokenizer_source: base
46
+
47
+ ```