Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
base_model:
|
4 |
+
- Rombo-Org/Rombo-LLM-V3.0-Qwen-32b
|
5 |
+
license: apache-2.0
|
6 |
+
datasets:
|
7 |
+
- NovaSky-AI/Sky-T1_data_17k
|
8 |
+
---
|
9 |
+
# Like my work? Support me on patreon for only $5 a month and get to vote on what model's i make next as well as get access to this org's private repo's
|
10 |
+
Subscribe bellow:
|
11 |
+
- Patreon.com/Rombodawg
|
12 |
+
__________________________________________________
|
13 |
+
|
14 |
+
# Rombo-LLM-V3.0-Qwen-32b
|
15 |
+
|
16 |
+

|
17 |
+
|
18 |
+
Rombo-LLM-V3.0-Qwen-32b is a Continued Finetune model on top of the previous V2.5 version using the "NovaSky-AI/Sky-T1_data_17k" dataset. The resulting model was then merged backed into the base model for higher performance as written in the continuous finetuning technique bellow:
|
19 |
+
|
20 |
+
- https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
|