Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Will write a proper model card later.
|
| 2 |
+
|
| 3 |
+
It's adamo1139/Yi-1.5-34B-32K-rebased-1406 finetuned on MaziyarPanahi/magpie-ultra-v0.1-sharegpt for one epoch. 128 rank lora with ctx 8192 and batch size 8, took around 5 hours on single H200. ChatML prompt format.
|
| 4 |
+
Training script is [here](https://huggingface.co/datasets/adamo1139/misc/blob/main/unstructured_unsloth_configs_dump/yi-34b-15-ft-magpie-ultra-lora-0611.py)
|