EvalPlus

university

https://evalplus.github.io/

evalplus

AI & ML interests

Evaluation of Languages Models on Code.

ganler

updated a Space 8 months ago

README

ganler

authored 3 papers 9 months ago

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22, 2024 • 48

Evaluating Language Models for Efficient Code Generation

Paper • 2408.06450 • Published Aug 12, 2024

Learning Code Preference via Synthetic Evolution

Paper • 2410.03837 • Published Oct 4, 2024

ganler

updated a dataset 9 months ago

evalplus/evalperf

Viewer • Updated Oct 17, 2024 • 120 • 240 • 3

ganler

updated a dataset about 1 year ago

evalplus/humanevalplus

Viewer • Updated May 1, 2024 • 164 • 11.9k • 10

ganler

authored a paper about 1 year ago

XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts

Paper • 2404.15247 • Published Apr 23, 2024 • 3

ganler

updated a dataset over 1 year ago

evalplus/mbppplus

Viewer • Updated Apr 17, 2024 • 378 • 17.8k • 11

ganler

authored 7 papers over 1 year ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 147

NeuRI: Diversifying DNN Generation via Inductive Rule Inference

Paper • 2302.02261 • Published Feb 4, 2023 • 3

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Paper • 2305.01210 • Published May 2, 2023 • 3

NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers

Paper • 2207.13066 • Published Jul 26, 2022

Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutation

Paper • 2202.09947 • Published Feb 21, 2022

Magicoder: Source Code Is All You Need

Paper • 2312.02120 • Published Dec 4, 2023 • 82

Relax: Composable Abstractions for End-to-End Dynamic Machine Learning

Paper • 2311.02103 • Published Nov 1, 2023 • 22