Modified intro
Browse files
utils.py
CHANGED
|
@@ -31,9 +31,7 @@ LEADERBOARD_INTRODUCTION = """# Chumor Leaderboard
|
|
| 31 |
We construct Chumor, the first Chinese humor explanation dataset that exceeds the size of existing humor datasets. Chumor is sourced from Ruo Zhi Ba (弱智吧), a Chinese Reddit-like platform known for sharing intellectually challenging and culturally specific jokes.
|
| 32 |
|
| 33 |
|
| 34 |
-
## What's new about
|
| 35 |
-
|
| 36 |
-
Compared to the original MMLU, there are three major differences:
|
| 37 |
|
| 38 |
Unlike existing datasets that focus on tasks such as humor detection, punchline identification, or humor generation, Chumor addresses the challenge of humor explanation. This involves not just identifying humor but understanding the reasoning behind it, a task that requires both linguistic and cultural knowledge. Specifically, Chumor tasks the LLMs with determining whether an explanation fully explains the joke. We source the explanations from GPT-4o and ERNIE-4-turbo, and have the entire dataset manually annotated by five native Chinese speakers.
|
| 39 |
|
|
|
|
| 31 |
We construct Chumor, the first Chinese humor explanation dataset that exceeds the size of existing humor datasets. Chumor is sourced from Ruo Zhi Ba (弱智吧), a Chinese Reddit-like platform known for sharing intellectually challenging and culturally specific jokes.
|
| 32 |
|
| 33 |
|
| 34 |
+
## What's new about Chumor
|
|
|
|
|
|
|
| 35 |
|
| 36 |
Unlike existing datasets that focus on tasks such as humor detection, punchline identification, or humor generation, Chumor addresses the challenge of humor explanation. This involves not just identifying humor but understanding the reasoning behind it, a task that requires both linguistic and cultural knowledge. Specifically, Chumor tasks the LLMs with determining whether an explanation fully explains the joke. We source the explanations from GPT-4o and ERNIE-4-turbo, and have the entire dataset manually annotated by five native Chinese speakers.
|
| 37 |
|