Llama-3.1-8B-basemerge / config-helpful.yaml
Nelathan's picture
Upload folder using huggingface_hub
c082c76 verified
raw
history blame contribute delete
611 Bytes
merge_method: model_stock
dtype: bfloat16
base_model: NousResearch/Meta-Llama-3.1-8B
models:
- model: NousResearch/Meta-Llama-3.1-8B-Instruct
parameters:
weight: 0.5
- model: allenai/Llama-3.1-Tulu-3-8B-SFT
parameters:
weight: 0.5
- model: arcee-ai/Llama-3.1-SuperNova-Lite
parameters:
weight: 0.5
- model: nvidia/Llama-3.1-Nemotron-Nano-8B-v1
parameters:
weight: 0.5
- model: NousResearch/DeepHermes-3-Llama-3-8B-Preview
parameters:
weight: 0.3
- model: deepcogito/cogito-v1-preview-llama-8B
parameters:
weight: 0.3