---
base_model:
- TroyDoesAI/BlackSheep-24B
- PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
- Gryphe/Pantheon-RP-1.8-24b-Small-3.1
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [TroyDoesAI/BlackSheep-24B](https://huggingface.co/TroyDoesAI/BlackSheep-24B) as a base.

### Models Merged

The following models were included in the merge:
* [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
* [Gryphe/Pantheon-RP-1.8-24b-Small-3.1](https://huggingface.co/Gryphe/Pantheon-RP-1.8-24b-Small-3.1)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
 - model: TroyDoesAI/BlackSheep-24B
   parameters:
     density: 0.9
     weight: 1
 - model: Gryphe/Pantheon-RP-1.8-24b-Small-3.1
   parameters:
     density: 0.6
     weight: 0.8
 - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
   parameters:
     density: 0.8
     weight: 0.6
merge_method: dare_ties
base_model: TroyDoesAI/BlackSheep-24B
tokenizer_source: base
parameters:
  rescale: true
dtype: bfloat16
```