NeuralPivot-11b / README.md
athirdpath's picture
Create README.md
86e995c
metadata
license: apache-2.0

A 11b Mistral model, based on the NeverSleep recipe.

Recipe

slices

  • sources:

    • model: maywell/PiVoT-0.1-Starling-LM-RP
    • layer_range: [0, 24]
  • sources:

    • model: Intel/neural-chat-7b-v3-1
    • layer_range: [8, 32]

merge_method: passthrough

dtype: bfloat16