A Pruned Mistral model
This model is a pruned Mistral model re-aligned using the Zephyr Recipe
details
- This model has 2 stages training: SFT and DPO
- The initial model consist on selecting some layers of the mistral model to make a smaller model
- the code can be found here: github.com/tcapelle/shear
W&B workspace
- Downloads last month
- 7
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for wandb/pruned_mistral
Base model
mistralai/Mistral-7B-v0.1