BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
49
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
All models, datasets, and demos related to StarCoder!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
215
BigCodeBench Leaderboard
🥇Explore and analyze code evaluation data
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 97.2k • 62 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 24k • 3
Models based on either StarCoder or The Stack!
StarCoder2 models and datasets!
All models, datasets, and demos related to StarCoder!
Datasets and spaces related to The Stack!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
215
BigCodeBench Leaderboard
🥇Explore and analyze code evaluation data
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 48 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 97.2k • 62 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 24k • 3
Models based on either StarCoder or The Stack!