SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories
Paper
•
2409.07440
•
Published
•
8
Shashank Gupta
shatu
AI & ML interests
Reasoning; Multi-hop Question Answering
Recent Activity
updated
a dataset
9 days ago
ai2-adapt-dev/appworld-api-cross-apps
published
a dataset
9 days ago
ai2-adapt-dev/appworld-api-cross-apps
updated
a dataset
9 days ago
ai2-adapt-dev/appworld-cross-apps-test
Organizations
authored
a
paper
10 months ago
authored
5
papers
12 months ago
Self-Refine: Iterative Refinement with Self-Feedback
Paper
•
2303.17651
•
Published
•
2
Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
Paper
•
2204.07689
•
Published
Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
Paper
•
2311.04892
•
Published
•
1
LLM-SR: Scientific Equation Discovery via Programming with Large Language Models
Paper
•
2404.18400
•
Published
•
1
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Paper
•
2407.18901
•
Published
•
35