More 12B models.
I'm aware that you just started this new leaderboard and probably are planning to do it anyway, it's a pity that the old data was lost, but just to add some:
https://huggingface.co/Undi95/Lumimaid-Magnum-v4-12B
https://huggingface.co/Epiculous/Violet_Twilight-v0.2
https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B
https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.2
https://huggingface.co/ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.3
https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9
https://huggingface.co/Nitral-AI/Captain_BMO-12B
https://huggingface.co/Nitral-AI/Nera_Noctis-12B
https://huggingface.co/Nitral-AI/Captain_Eris_Noctis-12B-v0.420
https://huggingface.co/Sao10K/MN-12B-Vespa-x1
https://huggingface.co/Sao10K/MN-12B-Lyra-v1
https://huggingface.co/Sao10K/MN-12B-Lyra-v4
https://huggingface.co/FallenMerick/MN-Violet-Lotus-12B
Thank you for the benchmark!
The old data isn't really lost, I'm keeping it in the files if anyone still wants to take a look. But yeah, I'll get to adding these.
The old data isn't really lost, I'm keeping it in the files if anyone still wants to take a look. But yeah, I'll get to adding these.
Thank you man, UGI is my leaderboard of reference. Great job.
Done!
Sao10K/MN-12B-Lyra-v1 and MarinaraSpaghetti/NemoMix-Unleashed-12B did the best at ugi by a good bit. Happy with those results, they're both pretty critically acclaimed models.
Thank you!
It's incredible that base Mistral Nemo 12b has a higher W/10 than all the fine-tunes based on it.
Didn't expect Celeste v1.9 to do so bad, having into account that it was the best (or close to) 12b model using the old UGI system.