EerieLight-21B / README.md
yamatazen's picture
Update README.md
93a798c verified
---
base_model:
- yamatazen/EtherealAurora-12B
library_name: transformers
tags:
- mergekit
- merge
- chatml
- frankenmerge
- upscaled
language:
- en
- ja
---
![image/png](https://huggingface.co/yamatazen/EerieLight-21B/resolve/main/EerieLight-21B.png?download=true)
This model seems to be stable. No repetition issues were found.
# merge
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the Passthrough merge method.
### Models Merged
The following models were included in the merge:
* [yamatazen/EtherealAurora-12B](https://huggingface.co/yamatazen/EtherealAurora-12B)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
merge_method: passthrough
dtype: bfloat16
slices:
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [0,10]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [2,12]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [10,20]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [12,22]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [20,30]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [22,32]
- sources:
- model: yamatazen/EtherealAurora-12B
layer_range: [30,40]
```