Spaces:
Running
on
CPU Upgrade
Question about Pending Submissions
Hi,
First of all, thank you for maintaining this leaderboard — it’s a great impact for the community.
I have submitted a new model to the leaderboard. I noticed that there are currently 4 models in the Pending List , and from checking the commit history in llm-jp/leaderboard-results, it seems there haven’t been new result updates since around July 13th.
Could I kindly ask:
- When can we expect the next update of the leaderboard?
- Is there a regular update schedule?
For context, this submission of Flux-Japanese-Qwen2.5-32B-Instruct-V1.0 is an enhanced version of the current top-ranked model, with further improvements specifically targeted at Japanese language understanding and generation. I believe this could provide a meaningful point of comparison for the leaderboard’s primary audience.
Great thanks!
Thank you for your message @deep-analysis-research
Last month, the Open Japanese LLM Leaderboard was shutdown (due to the MDX instances). We are currently working on restarting, and updating the leaderboard. We cannot provide a clear date. Hopefully, it will be resolved quickly. 🙇♂️
Many thanks for your patience!
Best,
Akim
Thank you for the update, @AkimfromParis .
We truly appreciate your efforts . Hope the issues can be resolved as soon as possible. If there’s a more concrete schedule for the restart, we would be grateful if you could let us know.
Once the system is back online, would it be possible to prioritize the evaluation of our latest submission? It builds directly upon the current top-ranked model with further enhancements in Japanese performance, and we believe the results could provide useful benchmarks for others as well.
Thanks again for your dedication and for keeping us informed.
Hi @Akim ,
Hope you had a good weekend!
Just wanted to kindly check in to see if there have been any updates on the progress of restarting the leaderboard. We really value the leaderboard and are looking forward to seeing it back online.
Thanks again for all your hard work, and we appreciate any updates you can share!