Commit
•
33d3049
1
Parent(s):
e5c5b34
Add evaluation results on the mlqa config and test.ar split of xglue
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the mlqa config and test.ar split of the [xglue](https://huggingface.co/datasets/xglue) dataset by
@Anwaarma
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-xglue-mlqa-a70280-48375145242).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xglue).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xglue).
README.md
CHANGED
@@ -1,7 +1,4 @@
|
|
1 |
---
|
2 |
-
tags:
|
3 |
-
- summarization
|
4 |
-
- mT5
|
5 |
language:
|
6 |
- am
|
7 |
- ar
|
@@ -46,11 +43,70 @@ language:
|
|
46 |
- vi
|
47 |
- cy
|
48 |
- yo
|
|
|
|
|
|
|
49 |
licenses:
|
50 |
- cc-by-nc-sa-4.0
|
51 |
widget:
|
52 |
-
- text:
|
53 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
---
|
55 |
|
56 |
# mT5-m2o-arabic-CrossSum
|
|
|
1 |
---
|
|
|
|
|
|
|
2 |
language:
|
3 |
- am
|
4 |
- ar
|
|
|
43 |
- vi
|
44 |
- cy
|
45 |
- yo
|
46 |
+
tags:
|
47 |
+
- summarization
|
48 |
+
- mT5
|
49 |
licenses:
|
50 |
- cc-by-nc-sa-4.0
|
51 |
widget:
|
52 |
+
- text: Videos that say approved vaccines are dangerous and cause autism, cancer or
|
53 |
+
infertility are among those that will be taken down, the company said. The policy
|
54 |
+
includes the termination of accounts of anti-vaccine influencers. Tech giants
|
55 |
+
have been criticised for not doing more to counter false health information on
|
56 |
+
their sites. In July, US President Joe Biden said social media platforms were
|
57 |
+
largely responsible for people's scepticism in getting vaccinated by spreading
|
58 |
+
misinformation, and appealed for them to address the issue. YouTube, which is
|
59 |
+
owned by Google, said 130,000 videos were removed from its platform since last
|
60 |
+
year, when it implemented a ban on content spreading misinformation about Covid
|
61 |
+
vaccines. In a blog post, the company said it had seen false claims about Covid
|
62 |
+
jabs "spill over into misinformation about vaccines in general". The new policy
|
63 |
+
covers long-approved vaccines, such as those against measles or hepatitis B. "We're
|
64 |
+
expanding our medical misinformation policies on YouTube with new guidelines on
|
65 |
+
currently administered vaccines that are approved and confirmed to be safe and
|
66 |
+
effective by local health authorities and the WHO," the post said, referring to
|
67 |
+
the World Health Organization.
|
68 |
+
model-index:
|
69 |
+
- name: csebuetnlp/mT5_m2o_arabic_crossSum
|
70 |
+
results:
|
71 |
+
- task:
|
72 |
+
type: summarization
|
73 |
+
name: Summarization
|
74 |
+
dataset:
|
75 |
+
name: xglue
|
76 |
+
type: xglue
|
77 |
+
config: mlqa
|
78 |
+
split: test.ar
|
79 |
+
metrics:
|
80 |
+
- type: rouge
|
81 |
+
value: 0.1874
|
82 |
+
name: ROUGE-1
|
83 |
+
verified: true
|
84 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDAwNWEyMzY2Y2E4N2ZlMWFmNjU1ZGM2Y2VmNjNhYTE0ZWJlZjA2NzBmY2VjY2ViZjRjNjU5ODhiYWJlN2E0NCIsInZlcnNpb24iOjF9.AcXy911VMGaPiT-gYKbUi9s5mM5BjTmZGo4h045IEId9qj3DRXn5rXVoMGmxBR53HXiUYOqMeGYCaGwk63vMBg
|
85 |
+
- type: rouge
|
86 |
+
value: 0.0
|
87 |
+
name: ROUGE-2
|
88 |
+
verified: true
|
89 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTA2YmI4NmEyZWQwN2ZmYWMwZGM3MjEzYWRkMzExYmY0OTIxYzc3ZjY5YmQ0MDIyZjY3NmExY2RlMDMwNDRiNyIsInZlcnNpb24iOjF9.-V1k8LSpeVyVAT3Jo-AUBzosq5cn6XSCZIXKOvloSIvdSMGEra9T6A2DjTDnlW4XtBterquktcbRoQv-v5yfDw
|
90 |
+
- type: rouge
|
91 |
+
value: 0.1937
|
92 |
+
name: ROUGE-L
|
93 |
+
verified: true
|
94 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDZmNzZjMGZkOTc4NWJiY2ZmNzI5Y2UxYTFmODEwMTVkYzBhZTY5NDIzNWJlMWU1OTU3ODNlMGM1ZTA2MjEyMCIsInZlcnNpb24iOjF9.QlTWoMwD8Arcd3x1bfwtAuc3JWJbr7AR0YMze2eKy5RgGQFxlKXLfTlVoP9mdgfyXY5T8XWCchx9Df13XGPYCw
|
95 |
+
- type: rouge
|
96 |
+
value: 0.1874
|
97 |
+
name: ROUGE-LSUM
|
98 |
+
verified: true
|
99 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzY4ZmIwYTE4NGQyOWMxMzQ1MmEzZDZlMmNhOGJkYjk0YTk0MjY2NGE5YWRiMTcxY2QyOTliYWM4OTI5ZGM5YiIsInZlcnNpb24iOjF9.BBd0xsSXwmT349qgaLJF5jtAikUwktM8k8SdcVYwcbNbt2iazeETnEKm9JxKV9dnRaCLKPBkJVqOYymVh_pgBA
|
100 |
+
- type: loss
|
101 |
+
value: 5.084585666656494
|
102 |
+
name: loss
|
103 |
+
verified: true
|
104 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWU5MWQ0ODc5MTQ4ZDc0MDFmYWVjMDc5YTc3Y2ViYjM1YzY5NWYzZTU2ZjgxNTJlN2VmZTVkNThlMDQ4YTU3YiIsInZlcnNpb24iOjF9.rXlFN9iKMmcG84P4Z8_fj-3gLCB-Gej6WuerbwFfWOY3_K8YEnnR4vDxtegLOGDkWn9tdRsaxp9Ojqhpi7CdBQ
|
105 |
+
- type: gen_len
|
106 |
+
value: 42.6337
|
107 |
+
name: gen_len
|
108 |
+
verified: true
|
109 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTM0ZThkOGYzZjYwNzcxMzk3OTYwNTc2NzJlYWE0ODE2MWUwN2VjZDAxZDU2MWRjZWJiOTExNTI5ODk5N2MzNSIsInZlcnNpb24iOjF9.3dyGRE61FjmpFNTTGVB_pVVI_kr_YU1eXx736NFK9JxMJs50eP48ArYt1m2LutgxjMRo-PABAMhvjh8vcvbRBw
|
110 |
---
|
111 |
|
112 |
# mT5-m2o-arabic-CrossSum
|