Live Code Bench

community

https://livecodebench.github.io/

AI & ML interests

Holistic contamination-free evaluation of Code LLMs

Recent Activity

xu3kev authored a paper about 15 hours ago

M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models

StringChaos new activity about 1 month ago

livecodebench/code_generation_lite:load dataset error

FanjiaYan authored a paper about 2 months ago

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

View all activity

spaces 2

Code Generation Samples

View code problem evaluations

Configuration error

Leaderboard

models

None public yet

datasets 6

livecodebench/code_generation_lite

Updated Jan 14 • 53k • 35

livecodebench/execution-v2

Viewer • Updated Nov 26, 2024 • 479 • 1.08k • 3

livecodebench/code_generation

Viewer • Updated Jun 13, 2024 • 121 • 2.28k • 19

livecodebench/test_generation

Viewer • Updated Jun 13, 2024 • 442 • 2.31k • 4

livecodebench/submissions

Preview • Updated May 26, 2024 • 38

livecodebench/execution

Viewer • Updated Mar 12, 2024 • 479 • 410 • 4