license: apache-2.0 | |
Slerp Merge of [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) and [cookinai/CatMacaroni-Slerp](https://huggingface.co/cookinai/CatMacaroni-Slerp) | |
.yaml file for mergekit | |
``` | |
slices: | |
- sources: | |
- model: Mistral-7B-Instruct-v0.2 | |
layer_range: [0, 32] | |
- model: CatMacaroni-Slerp-7B | |
layer_range: [0, 32] | |
merge_method: slerp | |
base_model: Mistral-7B-Instruct-v0.2 | |
parameters: | |
t: | |
- value: [0, 0.3, 0.5, 0.7, 1] | |
dtype: float16 | |
``` |