Spaces:
Runtime error
Runtime error
Commit
·
5c64d66
1
Parent(s):
d02447f
Change description
Browse files- src/about.py +8 -1
src/about.py
CHANGED
@@ -30,7 +30,14 @@ TITLE = """<h1 align="center" id="space-title">HunEval leaderboard</h1>"""
|
|
30 |
|
31 |
# What does your leaderboard evaluate?
|
32 |
INTRODUCTION_TEXT = """
|
33 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
"""
|
35 |
|
36 |
# Which evaluations are you running? how can people reproduce what you have?
|
|
|
30 |
|
31 |
# What does your leaderboard evaluate?
|
32 |
INTRODUCTION_TEXT = """
|
33 |
+
The HunEval leaderboard assesses the performance of models on a benchmark designed to evaluate their proficiency in understanding the Hungarian language and its nuances. The benchmark comprises two
|
34 |
+
primary components: (1) linguistic comprehension tasks, which aim to gauge a model's ability to interpret and process Hungarian text; and (2) knowledge-based tasks that examine a model's familiarity
|
35 |
+
with Hungarian cultural and linguistic phenomena. The benchmark is comprised of multiple sub-tasks, each targeting a distinct aspect of the model's performance.
|
36 |
+
|
37 |
+
In designing the benchmark, our objective was to create challenges that would be intuitive for native Hungarian speakers or individuals with extensive exposure to the language, but potentially more
|
38 |
+
demanding for models without prior training on Hungarian data. As such, we anticipate that models trained on Hungarian datasets will perform well on the benchmark, whereas those lacking this experience
|
39 |
+
may encounter difficulties. Notwithstanding, a model's strong performance on the benchmark does not imply expertise in a specific task; rather, it indicates a proficiency in understanding Hungarian
|
40 |
+
language and its structures.
|
41 |
"""
|
42 |
|
43 |
# Which evaluations are you running? how can people reproduce what you have?
|