BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
49
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode/guanaco-commits-m
Viewer
•
Updated
•
13.6k
•
4
bigcode/guanaco-commits
Viewer
•
Updated
•
13.6k
•
25
•
6
bigcode/starcoderdata
Viewer
•
Updated
•
207M
•
4.78k
•
445
bigcode/bigcode-pii-dataset
Viewer
•
Updated
•
12.1k
•
80
•
50
bigcode/stack-dedup-alt-comments
Viewer
•
Updated
•
32.7M
•
46
bigcode/bigcode-pii-dataset-training
Viewer
•
Updated
•
11.9k
•
6
•
11
bigcode/ta-prompt
Viewer
•
Updated
•
650
•
97
•
199
bigcode/the-stack-smol
Viewer
•
Updated
•
300k
•
493
•
53
bigcode/santacoder-fim-task
Viewer
•
Updated
•
4.79k
•
166
•
11
bigcode/pseudo-labeled-python-data-pii-detection-filtered
Viewer
•
Updated
•
17.7k
•
6
•
7
bigcode/commits-8192
Viewer
•
Updated
•
408k
•
11
•
3
bigcode/code-exchange
Viewer
•
Updated
•
7.66M
•
41
•
7
bigcode/commits-codegeex
Viewer
•
Updated
•
2.67M
•
107
•
5
bigcode/github-commits-diff-dedup-pjjs-april
Viewer
•
Updated
•
146k
•
1.16k
•
3
bigcode/the-stack
Viewer
•
Updated
•
546M
•
16.7k
•
832
bigcode/commits-pjj-2048
Viewer
•
Updated
•
1.85M
•
12
bigcode/commits-pjj-diff
Viewer
•
Updated
•
2.6M
•
268
•
2
bigcode/the-stack-github-issues
Viewer
•
Updated
•
31M
•
256
•
43
bigcode/the-stack-metadata
Viewer
•
Updated
•
10.8B
•
211
•
6
bigcode/the-stack-march-sample-special-tokens-stripped
Viewer
•
Updated
•
747k
•
169
bigcode/programming-languages-keywords
Viewer
•
Updated
•
36
•
30
•
6
bigcode/jupyter-code-text-pairs
Viewer
•
Updated
•
9.31M
•
85
•
9
bigcode/jupyter-parsed
Viewer
•
Updated
•
1.46M
•
59
•
4
bigcode/santacoder-token-usage
Viewer
•
Updated
•
49.1k
•
13
bigcode/the-stack-inspection-data
Preview
•
Updated
•
14
•
2
bigcode/the-stack-smol-xs
Viewer
•
Updated
•
8.7k
•
611
•
8
bigcode/the-stack-smol-xl
Viewer
•
Updated
•
541k
•
186
•
5
bigcode/the-stack-username-to-repo
Updated
•
9
•
1