allura-forge/q3-8b-rc1

output

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using Qwen/Qwen3-8B-Base as a base.

Models Merged

The following models were included in the merge:

• allura-forge/q3-8b-ft-ep2-merged
• allura-org/remnant-qwen3-8b

Configuration

The following YAML configuration was used to produce this model:

base_model: Qwen/Qwen3-8B-Base
models:
  - model: allura-forge/q3-8b-ft-ep2-merged
    parameters:
      weight: 0.75
      density: 0.9
  - model: allura-org/remnant-qwen3-8b
    parameters:
      weight: 0.25
      density: 0.5
merge_method: ties
dtype: bfloat16