Update README.md
Browse files
README.md
CHANGED
@@ -135,3 +135,20 @@ Noting the last remark, while the lora works it was really just for getting more
|
|
135 |
* From [Kimiko-LLaMA-2-7b](https://huggingface.co/johnwick123forevr/Llama2-chat-kimiko-Sharded-2gb)
|
136 |
* 3 epochs
|
137 |
* Lora of [l2-7b-monika-ddlc-v0.3m-Kv2-c](https://huggingface.co/922-CA/l2-7b-monika-ddlc-v0.3m-Kv2-c)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
135 |
* From [Kimiko-LLaMA-2-7b](https://huggingface.co/johnwick123forevr/Llama2-chat-kimiko-Sharded-2gb)
|
136 |
* 3 epochs
|
137 |
* Lora of [l2-7b-monika-ddlc-v0.3m-Kv2-c](https://huggingface.co/922-CA/l2-7b-monika-ddlc-v0.3m-Kv2-c)
|
138 |
+
|
139 |
+
# monika-ddlc-mistral-v0.1-7b-test qloras (~10/03/2023)
|
140 |
+
* Fine-tuned on then WIP partially manually-edited version of [this dataset](https://huggingface.co/datasets/922-CA/lm2_08312023_test4_raw_MoChA_2-t)
|
141 |
+
* From [Mistral-7b-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
|
142 |
+
* Various epochs (2, 3, 10)
|
143 |
+
* All had repetition issues, hence why LLaMA-2-7b chat was reused for later versions; may retest again
|
144 |
+
|
145 |
+
# monika-ddlc-l2-v0.9 qloras (~10/07/2023)
|
146 |
+
* Fine-tuned on then WIP partially manually-edited version of [this dataset](https://huggingface.co/datasets/922-CA/lm2_08312023_test4_raw_MoChA_2-t)
|
147 |
+
* From chat LLaMA-2s (7b, 13b)
|
148 |
+
* 3 epochs
|
149 |
+
|
150 |
+
# monika-ddlc-v1 qloras (~10/03/2023)
|
151 |
+
* Fine-tuned on [MoCha v1](https://huggingface.co/datasets/922-CA/MoCha_v1)
|
152 |
+
* From chat LLaMA-2-7b
|
153 |
+
* 3 epochs
|
154 |
+
* Lora of [monika-ddlc-7b-v1](https://huggingface.co/922-CA/monika-ddlc-7b-v1)
|