Update README.md
Browse files
README.md
CHANGED
@@ -72,9 +72,11 @@ The model was trained using MyLLM framework:
|
|
72 |
|
73 |
The model was trained utilizing 2 stages:
|
74 |
- Stage 1:
|
75 |
-
- Datasets: GrandMaster
|
|
|
76 |
- Stage 2:
|
77 |
-
- Datasets: Kolmogorov-3, Russian Code
|
|
|
78 |
|
79 |
All configs are available in MyLLM repository.
|
80 |
|
|
|
72 |
|
73 |
The model was trained utilizing 2 stages:
|
74 |
- Stage 1:
|
75 |
+
- Datasets: GrandMaster
|
76 |
+
- LoRA: rank=128, alpha=256
|
77 |
- Stage 2:
|
78 |
+
- Datasets: Kolmogorov-3, Russian Code
|
79 |
+
- LoRA: rank=256, alpha=256
|
80 |
|
81 |
All configs are available in MyLLM repository.
|
82 |
|