xianbao commited on
Commit
6bb6b51
·
verified ·
1 Parent(s): 0fb889e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -6,4 +6,22 @@ extra_gated_fields:
6
  I agree to use this model for non-commercial use ONLY: checkbox
7
  ---
8
 
9
- hello
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  I agree to use this model for non-commercial use ONLY: checkbox
7
  ---
8
 
9
+ <details style="display: inline;"><summary> If you're interested in Yi's adoption of LLaMA architecture and license usage policy, see <span style="color: green;">Yi's relation with LLaMA.</span> ⬇️</summary> <ul> <br>
10
+ > 💡 TL;DR
11
+ >
12
+ > The Yi series models adopt the same model architecture as LLaMA but are **NOT** derivatives of LLaMA.
13
+
14
+ - Both Yi and LLaMA are all based on the Transformer structure, which has been the standard architecture for large language models since 2018.
15
+
16
+ - Grounded in the Transformer architecture, LLaMA has become a new cornerstone for the majority of state-of-the-art open-source models due to its excellent stability, reliable convergence, and robust compatibility. This positions LLaMA as the recognized foundational framework for models including Yi.
17
+
18
+ - Thanks to the Transformer and LLaMA architectures, other models can leverage their power, reducing the effort required to build from scratch and enabling the utilization of the same tools within their ecosystems.
19
+
20
+ - However, the Yi series models are NOT derivatives of LLaMA, as they do not use LLaMA's weights.
21
+
22
+ - As LLaMA's structure is employed by the majority of open-source models, the key factors of determining model performance are training datasets, training pipelines, and training infrastructure.
23
+
24
+ - Developing in a unique and proprietary way, Yi has independently created its own high-quality training datasets, efficient training pipelines, and robust training infrastructure entirely from the ground up. This effort has led to excellent performance with Yi series models ranking just behind GPT4 and surpassing LLaMA on the [Alpaca Leaderboard in Dec 2023](https://tatsu-lab.github.io/alpaca_eval/).
25
+ </ul>
26
+ </details>
27
+