Update README.md
Browse files
README.md
CHANGED
|
@@ -31,7 +31,6 @@ Best results with "Human" and "Assistant" and prompt with Tagalog. Example:
|
|
| 31 |
* lora dropout: 0
|
| 32 |
* lr: 2e-4
|
| 33 |
* batch size: 2
|
| 34 |
-
* warmup ratio: 0.075
|
| 35 |
* grad steps: 4
|
| 36 |
|
| 37 |
This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
|
|
|
| 31 |
* lora dropout: 0
|
| 32 |
* lr: 2e-4
|
| 33 |
* batch size: 2
|
|
|
|
| 34 |
* grad steps: 4
|
| 35 |
|
| 36 |
This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|