metadata
base_model:
- Ttimofeyka/Tissint-14B-v1.2-128k-RP
- SicariusSicariiStuff/Impish_QWEN_14B-1M
- Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
- deepcogito/cogito-v1-preview-qwen-14B
- Sao10K/14B-Qwen2.5-Freya-x1
- Sao10K/14B-Qwen2.5-Kunou-v1
- Sorawiz/Qwen2.5-14B-GCC
library_name: transformers
tags:
- mergekit
- merge
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using Sorawiz/Qwen2.5-14B-1M-Instinct as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
name: Sorawiz/Qwen2.5-14B-Instinct-Base
merge_method: dare_ties
base_model: Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
models:
- model: Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
parameters:
weight: 0.3
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.7
parameters:
density: 1
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-Instincto
merge_method: dare_ties
base_model: deepcogito/cogito-v1-preview-qwen-14B
models:
- model: deepcogito/cogito-v1-preview-qwen-14B
parameters:
weight: 0.4
- model: Sorawiz/Qwen2.5-14B-Instinct-Base
parameters:
weight: 0.3
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.3
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-Kunousint
merge_method: dare_ties
base_model: Sao10K/14B-Qwen2.5-Kunou-v1
models:
- model: Sao10K/14B-Qwen2.5-Kunou-v1
parameters:
weight: 0.5
- model: Sorawiz/Qwen2.5-14B-Instincto
parameters:
weight: 0.3
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.2
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-Kunousint-1M
merge_method: dare_ties
base_model: Sorawiz/Qwen2.5-14B-Imstinct
models:
- model: Sorawiz/Qwen2.5-14B-Imstinct
parameters:
weight: 0.2
- model: Sorawiz/Qwen2.5-14B-Kunousint
parameters:
weight: 0.5
- model: Sao10K/14B-Qwen2.5-Kunou-v1
parameters:
weight: 0.3
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-Frayasint
merge_method: dare_ties
base_model: Sao10K/14B-Qwen2.5-Freya-x1
models:
- model: Sao10K/14B-Qwen2.5-Freya-x1
parameters:
weight: 0.5
- model: Sorawiz/Qwen2.5-14B-Instincto
parameters:
weight: 0.3
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.2
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-Frayasint-1M
merge_method: dare_ties
base_model: Sorawiz/Qwen2.5-14B-Imstinct
models:
- model: Sorawiz/Qwen2.5-14B-Imstinct
parameters:
weight: 0.2
- model: Sorawiz/Qwen2.5-14B-Frayasint
parameters:
weight: 0.5
- model: Sao10K/14B-Qwen2.5-Freya-x1
parameters:
weight: 0.3
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto
---
name: Sorawiz/Qwen2.5-14B-1M-Instinct
merge_method: dare_ties
base_model: Sorawiz/Qwen2.5-14B-Imstinct
models:
- model: Sorawiz/Qwen2.5-14B-Imstinct
parameters:
weight: 0.25
- model: Sorawiz/Qwen2.5-14B-1M-Kunousint-1M
parameters:
weight: 0.25
- model: Sorawiz/Qwen2.5-14B-Frayasint-1M
parameters:
weight: 0.25
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.25
parameters:
density: 1
tokenizer:
source: union
chat_template: auto
---
merge_method: dare_ties
base_model: Sorawiz/Qwen2.5-14B-1M-Instinct
models:
- model: Sorawiz/Qwen2.5-14B-1M-Instinct
parameters:
weight: 0.40
- model: Ttimofeyka/Tissint-14B-v1.2-128k-RP
parameters:
weight: 0.25
- model: SicariusSicariiStuff/Impish_QWEN_14B-1M
parameters:
weight: 0.25
- model: Sorawiz/Qwen2.5-14B-GCC
parameters:
weight: 0.10
parameters:
density: 0.5
tokenizer:
source: union
chat_template: auto