CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding Capabilities of CodeLLMs
Paper
•
2410.01999
•
Published
•
10
•
4
Nghi Bui
bdqnghi
AI & ML interests
AI4Software, AI4Code, CodeLLMs, Code Generation, Autonomous Agents
Recent Activity
liked
a dataset
about 12 hours ago
nvidia/Llama-Nemotron-Post-Training-Dataset
liked
a model
8 days ago
Kwaipilot/KAT-V1-40B
upvoted
a
collection
2 months ago
Deepseek Papers
Organizations
commented
a
paper
10 months ago
commented
4
papers
about 1 year ago
Learning to Predict Program Execution by Modeling Dynamic Dependency on Code Graphs
Paper
•
2408.02816
•
Published
•
5
•
2
REPOEXEC: Evaluate Code Generation with a Repository-Level Executable Benchmark
Paper
•
2406.11927
•
Published
•
11
•
1
AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology
Paper
•
2406.11912
•
Published
•
28
•
2
AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology
Paper
•
2406.11912
•
Published
•
28
•
2