Hibrid-Llama-Linear / mergekit_config.yml
matrixportal's picture
Upload folder using huggingface_hub
c2ff2a2 verified
model_type: llama
dtype: bfloat16
merge_method: linear
models:
- model: ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
parameters:
weight: 0.5
- model: meta-llama/Llama-3.1-8B
parameters:
weight: 0.25
- model: meta-llama/Llama-3.1-8B-Instruct
parameters:
weight: 0.25