README.md

metadata

base_model:
  - NousResearch/Meta-Llama-3.1-8B
  - nvidia/Llama-3.1-Nemotron-Nano-8B-v1
  - NousResearch/DeepHermes-3-Llama-3-8B-Preview
  - deepcogito/cogito-v1-preview-llama-8B
  - NousResearch/Meta-Llama-3.1-8B
  - allenai/Llama-3.1-Tulu-3-8B-SFT
  - NousResearch/Meta-Llama-3.1-8B-Instruct
  - arcee-ai/Llama-3.1-SuperNova-Lite
  - NousResearch/Hermes-3-Llama-3.1-8B
  - ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
  - Sao10K/L3-8B-Lunaris-v1
  - TheDrummer/Llama-3SOME-8B-v2
  - Gryphe/Pantheon-RP-1.0-8b-Llama-3
library_name: transformers
tags:
  - mergekit
  - merge

output

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was first merged using the Model Stock merge method using NousResearch/Meta-Llama-3.1-8B as a base.

This model was merged using the NuSLERP merge method using NousResearch/Meta-Llama-3.1-8B as a base.

Models Merged

The following models were merged to helpful using the Model Stock merge method using NousResearch/Meta-Llama-3.1-8B as a base:

• nvidia/Llama-3.1-Nemotron-Nano-8B-v1
• NousResearch/DeepHermes-3-Llama-3-8B-Preview
• deepcogito/cogito-v1-preview-llama-8B
• NousResearch/Meta-Llama-3.1-8B
• allenai/Llama-3.1-Tulu-3-8B-SFT
• NousResearch/Meta-Llama-3.1-8B-Instruct
• arcee-ai/Llama-3.1-SuperNova-Lite

The following models were merged to immersive using the Model Stock merge method using NousResearch/Meta-Llama-3.1-8B as a base:

• NousResearch/Hermes-3-Llama-3.1-8B
• ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
• Sao10K/L3-8B-Lunaris-v1
• TheDrummer/Llama-3SOME-8B-v2
• Gryphe/Pantheon-RP-1.0-8b-Llama-3

Finally, the two models were merged using the NuSLERP merge method.

Configuration

The following YAML configuration was used to produce this model: ./config-helpful.yaml ./config-immersive.yaml ./config-basemerge.yaml