Spaces:
Runtime error
Runtime error
Commit
·
555dea6
1
Parent(s):
a1edac1
Update app.py
Browse files
app.py
CHANGED
@@ -100,8 +100,8 @@ table.index = table.index + 1
|
|
100 |
st.markdown("# XTREME-S: Evaluating Cross-lingual Speech Representations")
|
101 |
|
102 |
st.markdown(
|
103 |
-
|
104 |
-
This is the leaderboard
|
105 |
Submitted systems are ranked by the **average score**, which is a weighted average of
|
106 |
the mandatory test sets:
|
107 |
\n
|
@@ -133,7 +133,7 @@ st.markdown(
|
|
133 |
"""
|
134 |
## Submitting to XTREME-S
|
135 |
\n
|
136 |
-
To submit to XTREME-S, download the audio data for the mandatory XTREME-S test sets from [xtreme-s/datasets](https://huggingface.co/datasets/xtreme-s/datasets). The test sets contain audio data only. Evaluate your system on the
|
137 |
\n
|
138 |
Once you have evaluated your system on all of the six mandatory test sets, move the predictions into one folder and zip it. The name you assign to the zipped folder will be the name that is shown on the table (e.g. mSLAM.zip will be displayed as mSLAM). Upload your zipped submissions for scoring and placement on the leaderboard.
|
139 |
\n
|
|
|
100 |
st.markdown("# XTREME-S: Evaluating Cross-lingual Speech Representations")
|
101 |
|
102 |
st.markdown(
|
103 |
+
"""
|
104 |
+
This is the leaderboard for the XTREME-S benchmark.
|
105 |
Submitted systems are ranked by the **average score**, which is a weighted average of
|
106 |
the mandatory test sets:
|
107 |
\n
|
|
|
133 |
"""
|
134 |
## Submitting to XTREME-S
|
135 |
\n
|
136 |
+
To submit to XTREME-S, download the audio data for the mandatory XTREME-S test sets from [xtreme-s/datasets](https://huggingface.co/datasets/xtreme-s/datasets). The test sets contain audio data only. Evaluate your system on the six test sets by generating predictions for the unlabelled audio samples. For each test set, save the predictions to a .txt file in the order that the audio samples are provided, with one prediction per line. Name the .txt file according to the XTREME-S test set names shown in the table (e.g. the predictions for FLEURS should be named fleurs.txt).
|
137 |
\n
|
138 |
Once you have evaluated your system on all of the six mandatory test sets, move the predictions into one folder and zip it. The name you assign to the zipped folder will be the name that is shown on the table (e.g. mSLAM.zip will be displayed as mSLAM). Upload your zipped submissions for scoring and placement on the leaderboard.
|
139 |
\n
|