Create README.md

README.md

@@ -0,0 +1,128 @@
+---
+base_model:
+- yvvki/Erotophobia-24B-v2.0
+base_model_relation: quantized
+quantized_by: ArtusDev
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
+# Erotophobia-24-v2.0
+
+![Model Banner](banner.png)
+
+My second merge! Yayay!  
+*Technically my third but we'll ignore the first failed model :(*
+
+This model is just headache to do, it really is! It wasted me $20 trying to fit darkc0de/BlackXorDolphTronGOAT because it's a `float32` dtype!
+I didn't know I can downcast the model into `dfloat16` first until at the very end there.
+But, this model has the downcast in the [df16](df16) directory for your pleasure.
+
+> Still testing and awaiting GGUF. Please kindly give your patience. Thank you <3
+
+## Philosophy
+
+### Mind
+
+Fusion of darkc0de's fusions merge, and Acree's DeepSeek distill abliterated.
+
+I think this is a good base. The Xortron is the top performing at UGI leaderboard and Arcee has the DeepSeek distill and updated world information.
+
+### Heart
+
+Karcher with all 2503 base, using updated Dan's and Eurydice, and reintroduce Pantheon.
+
+I feel like this will improve the roleplay. All has the models have unique characteristics of their own, and hopefully the Karcher mean can find a nice center.
+
+### Soul
+
+Stock on Sleep's Omega Gaslight and Broken Tutu, since both based on Cydonia 2.1 and have the BlackSheep model in their merge.
+
+I'm horny...
+
+## Merge Details
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+### Merge Method
+
+This model was merged using multi-stage model merging method:
+
+- **Mind** was merged using the [Arcee Fusion](https://www.arcee.ai/blog/meet-mergekit-v0-1-arcee-fusion-expanded-model-support-multi-gpu-acceleration) merge method using huihui-ai/Arcee-Blitz-abliterated as a base.
+- **Heart** was merged using the [Karcher Mean](https://en.wikipedia.org/wiki/Karcher_mean) merge method.
+- **Soul** was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using TheDrummer/Cydonia-24B-v2.1 as a base.
+
+Fially, this model was merged using the [DELLA](https://arxiv.org/abs/2406.11617) merge method using **Mind** as a base.
+
+The partial merge results (**Mind**, **Heart**, and **Soul**) are available inside the [intermediates](intermediates) directory.
+
+### Models Merged
+
+The following models were included in the merge:
+* **Mind**
+  - darkc0de/BlackXorDolphTronGOAT
+* **Soul**
+  - PocketDoc/Dans-PersonalityEngine-V1.3.0-24b
+  - aixonlab/Eurydice-24b-v3.5
+  - Gryphe/Pantheon-RP-1.8-24b-Small-3.1
+* **Heart**
+  - ReadyArt/Broken-Tutu-24B
+  - ReadyArt/Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B
+
+### Configuration
+
+The following YAML configuration was used to produce this model (using `mergekit-multi`):
+
+```yaml
+name: Mind
+merge_method: arcee_fusion
+dtype: bfloat16
+tokenizer:
+  source: union
+chat_template: auto
+base_model: huihui-ai/Arcee-Blitz-abliterated
+models:
+  - model: darkc0de/BlackXorDolphTronGOAT
+---
+name: Heart
+merge_method: karcher
+tokenizer:
+  source: union
+chat_template: auto
+parameters:
+  max_iter: 1000
+models:
+  - model: PocketDoc/Dans-PersonalityEngine-V1.3.0-24b
+  - model: aixonlab/Eurydice-24b-v3.5
+  - model: Gryphe/Pantheon-RP-1.8-24b-Small-3.1
+---
+name: Soul
+merge_method: model_stock
+tokenizer:
+  source: union
+chat_template: auto
+base_model: TheDrummer/Cydonia-24B-v2.1
+models:
+  - model: ReadyArt/Broken-Tutu-24B
+  - model: ReadyArt/Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B
+---
+merge_method: della
+tokenizer:
+  source: union
+chat_template: auto
+base_model: Mind
+models:
+  - model: Mind
+  - model: Heart
+    parameters:
+      weight: 0.6
+  - model: Soul
+    parameters:
+      weight: 0.4
+parameters:
+  density: 0.7
+  epsilon: 0.2
+  lamda: 1.1
+```