submission model queue

#14
by shitianqi - opened

hi, The leaderboard is great. We have been following it, but we found that the submission queue is very long. Are there any plans for batch testing or machine expansion?

Yes, I have the same question. It seems the evaluation queue has been like this for months without moving forward.

hi, I have the same question! What's going one?

La Leaderboard org

Hi, I'm glad you like the leaderboard. We're currently evaluating all the models in the queue, along with additional ones - around 50 in total. Given the number of datasets, it does take some time. However, we will publish all the results before the end of the month. We appreciate your patience and interest.

mariagrandury changed discussion status to closed

Sign up or log in to comment