did imatrix fail?
#1
by
X5R
- opened
the i1 is still not released.
and, they also released pro and rm version.
- https://huggingface.co/ByteDance-Seed/Seed-X-PPO-7B
- https://huggingface.co/ByteDance-Seed/Seed-X-RM-7B
i don't know which is better.
Edit: I tried this model. there is either no translated content, or just repetition of first phase.
imatrix indeed failed. i'll try to queue the two other models
Seed-X-RM-7B: either llama.cpp didn't properly convert the model or it seems to be seriously hosed (e.g. tokenizer does not match the model weights)
llama_model_load: error loading model: check_tensor_dims: tensor 'token_embd.weight' has wrong shape; expected 4096, 65269, got 4096, 65272, 1, 1
and the PRO failed with nans during imatrix generation. tough world.