--- base_model: - yamatazen/EtherealAurora-12B library_name: transformers tags: - mergekit - merge - chatml - frankenmerge - upscaled language: - en - ja --- ![image/png](https://huggingface.co/yamatazen/EerieLight-21B/resolve/main/EerieLight-21B.png?download=true) This model seems to be stable. No repetition issues were found. # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the Passthrough merge method. ### Models Merged The following models were included in the merge: * [yamatazen/EtherealAurora-12B](https://huggingface.co/yamatazen/EtherealAurora-12B) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: passthrough dtype: bfloat16 slices: - sources: - model: yamatazen/EtherealAurora-12B layer_range: [0,10] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [2,12] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [10,20] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [12,22] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [20,30] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [22,32] - sources: - model: yamatazen/EtherealAurora-12B layer_range: [30,40] ```