Account not authorized to submit evaluations on GAIA leaderboard

#50
by koko7mi - opened

When attempting to submit evaluation results to the GAIA leaderboard on Hugging Face, I receive an error message stating 'this account is not authorized to submit on GAIA'. Please advise on how to obtain proper authorization.

GAIA org

Hi! Thanks for your interest in GAIA!
We prevent users with not enough activity on hugging face to submit to avoid spam, as people have been creating spam accounts just to troll the benchmark. There is nothing you can do at this point, sorry for the inconvenience.

clefourrier changed discussion status to closed

Hello, I have problems in being able to verify the goodness of the Agent to reach the certification, I do not understand why it should be placed under such a restriction.

I therefore ask you to be able to verify my Agent as soon as possible, thank you.

I have the same problem. Nothing to do to solve it?

I have the same problem... getting message that This account is not authorized to submit on GAIA... can this be checked ?

Hi! To all of you trying to submit for the course, you are not submitting in the correct place - the agent course has a specific leaderboard associated with it and it is not here (cc @burtenshaw )

🚨 AGENTS COURSE CERTIFICATION 🚨

To submit your unit 4 system and get a certificate for the Agents Course. Use this Unit4-Final-Certificate space.

gaia-benchmark/leaderboard is the leaderboard for academic submissions to the benchmark.

I have been registered for one month, but the activity degree is still insufficient. How to count the activity degree and how to improve it?

I submitted to the test set on 2025-04-11. The agent name is Thingo, and the organization (org) is ThingoTech.
Can you help me remove the record from the test set of the Leaderboard?

@1111jsq please wait a bit more
@Whliuyu No, we don't remove submissions

The result I submitted has serious issues, and the manager has demanded that it must be deleted. What information do I need to provide to delete the incorrect submission record?

We do not remove previous submissions to prevent spam (people submitting bad submissions then removing them), as well as for accountability and traceability.

Sign up or log in to comment