2aa8383 a05e6b8 2aa8383
1
2
3
4
5
6
7
8
9
10
11
```python python -m moetify.mix \ --output_dir ./moecule-3x3b-m5 \ --model_path unsloth/Llama-3.2-3B-Instruct \ --modules mlp q_proj \ --ingredients \ unsloth/Llama-3.2-3B-Instruct \ unsloth/Llama-3.2-3B-Instruct \ unsloth/Llama-3.2-3B-Instruct ```
