Spaces:
Running
on
A100
Persistent RuntimeError: all inputs to slice must contain the same amount of layers
I keep getting RuntimeError when merging models!! I tried so many things! slerp with qwen and calme... llama and qwen, qwen 1m with TIES... I don't get it! I want to ideally merge:
Qwen/Qwen2.5-14B-Instruct-1MMaziyarPanahi/calme-3.2-instruct-78bmeta-llama/Llama-3.1-70B-InstructSteelskull/L3.3-MS-Nevoria-70bSakalti/ultiima-72B
Ik thats a lot of models, and I don't mind dropping one or two. But I can't even merge 2!! Also I want to merge them to make sure that the best model is selected by task (e.g. ultiima is good at math so choose it for math questions).
Not all models have the same layer count.
Mergekit requires all models to have the same layer count.
@Austinkeith2010 How can I find the layer count? And is it possible to merge even with different layer counts?
You cannot merge models with different number of layers.
@Sakalti How can I find the layer count?
It is sometimes shown on the README.md file. It is important to READ the file.
Ok.