1 21 133

Mert Erbak PRO

merterbak

AI & ML interests

NLP and Image Processing

Recent Activity

reacted to their post with 🚀 1 day ago

OpenAI published 2 benchmark datasets on Hugging Face 🔥 https://huggingface.co/datasets/openai/mrcr https://huggingface.co/datasets/openai/graphwalks MRCR tests how well a model can find the right answer when many similar questions are spread out in a long context. Graphwalks checks if a model can follow steps in a big graph and find the correct nodes by thinking through the structure

reacted to thomwolf's post with 🚀 1 day ago

If you've followed the progress of robotics in the past 18 months, you've likely noticed how robotics is increasingly becoming the next frontier that AI will unlock. At Hugging Face—in robotics and across all AI fields—we believe in a future where AI and robots are open-source, transparent, and affordable; community-built and safe; hackable and fun. We've had so much mutual understanding and passion working with the Pollen Robotics team over the past year that we decided to join forces! You can already find our open-source humanoid robot platform Reachy 2 on the Pollen website and the Pollen community and people here on the hub at https://huggingface.co/pollen-robotics We're so excited to build and share more open-source robots with the world in the coming months!

upvoted an article 1 day ago

Hugging Face to sell open-source robots thanks to Pollen Robotics acquisition 🤖

View all activity

Organizations

Posts 6

Post

1875

OpenAI published 2 benchmark datasets on Hugging Face 🔥
openai/mrcr
openai/graphwalks
MRCR tests how well a model can find the right answer when many similar questions are spread out in a long context. Graphwalks checks if a model can follow steps in a big graph and find the correct nodes by thinking through the structure

Post

2904

OpenAI has released BrowseComp an open source benchmark designed to evaluate the web browsing capabilities of AI agents. This dataset comprising 1,266 questions challenges AI models to navigate the web and uncover complex and obscure information. Crafted by human trainers, the questions are intentionally difficult. (unsolvable by another person in under ten minutes and beyond the reach of existing models like ChatGPT with and without browsing and an early version of OpenAI's Deep Research tool.)

Blog Post: https://openai.com/index/browsecomp/
Paper: https://cdn.openai.com/pdf/5e10f4ab-d6f7-442e-9508-59515c65e35d/browsecomp.pdf
Code in simple eval repo: https://github.com/openai/simple-evals

View all Posts