karsar commited on
Commit
d5fc964
1 Parent(s): 188f01f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2425 -0
README.md CHANGED
@@ -1,3 +1,2428 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
3
  language:
 
1
+ ---
2
+ model-index:
3
+ - name: karsar/paraphrase-multilingual-MiniLM-L12-hu_v1
4
+ results:
5
+ - dataset:
6
+ config: hun_Latn-hun_Latn
7
+ name: MTEB BelebeleRetrieval (hun_Latn-hun_Latn)
8
+ revision: 75b399394a9803252cfec289d103de462763db7c
9
+ split: test
10
+ type: facebook/belebele
11
+ metrics:
12
+ - type: main_score
13
+ value: 77.865
14
+ - type: map_at_1
15
+ value: 67.333
16
+ - type: map_at_10
17
+ value: 74.404
18
+ - type: map_at_100
19
+ value: 74.802
20
+ - type: map_at_1000
21
+ value: 74.809
22
+ - type: map_at_20
23
+ value: 74.63
24
+ - type: map_at_3
25
+ value: 72.796
26
+ - type: map_at_5
27
+ value: 73.67399999999999
28
+ - type: mrr_at_1
29
+ value: 67.33333333333333
30
+ - type: mrr_at_10
31
+ value: 74.40396825396829
32
+ - type: mrr_at_100
33
+ value: 74.80177264047548
34
+ - type: mrr_at_1000
35
+ value: 74.80937346439818
36
+ - type: mrr_at_20
37
+ value: 74.62979204843244
38
+ - type: mrr_at_3
39
+ value: 72.7962962962963
40
+ - type: mrr_at_5
41
+ value: 73.6740740740741
42
+ - type: nauc_map_at_1000_diff1
43
+ value: 76.08133094195743
44
+ - type: nauc_map_at_1000_max
45
+ value: 61.727834175182736
46
+ - type: nauc_map_at_1000_std
47
+ value: -2.3231732437794568
48
+ - type: nauc_map_at_100_diff1
49
+ value: 76.07916259051902
50
+ - type: nauc_map_at_100_max
51
+ value: 61.72703450852774
52
+ - type: nauc_map_at_100_std
53
+ value: -2.3175338063349575
54
+ - type: nauc_map_at_10_diff1
55
+ value: 75.97996147738112
56
+ - type: nauc_map_at_10_max
57
+ value: 61.860784493617224
58
+ - type: nauc_map_at_10_std
59
+ value: -2.4887315051072356
60
+ - type: nauc_map_at_1_diff1
61
+ value: 78.13561632940586
62
+ - type: nauc_map_at_1_max
63
+ value: 59.243520843511746
64
+ - type: nauc_map_at_1_std
65
+ value: -2.6689239089679515
66
+ - type: nauc_map_at_20_diff1
67
+ value: 76.06883452011327
68
+ - type: nauc_map_at_20_max
69
+ value: 61.775589074510826
70
+ - type: nauc_map_at_20_std
71
+ value: -2.3905575770447585
72
+ - type: nauc_map_at_3_diff1
73
+ value: 75.85937006372846
74
+ - type: nauc_map_at_3_max
75
+ value: 61.819093557650895
76
+ - type: nauc_map_at_3_std
77
+ value: -2.5207238945764647
78
+ - type: nauc_map_at_5_diff1
79
+ value: 76.06929563357589
80
+ - type: nauc_map_at_5_max
81
+ value: 61.93563829360039
82
+ - type: nauc_map_at_5_std
83
+ value: -1.9424637593671918
84
+ - type: nauc_mrr_at_1000_diff1
85
+ value: 76.08133094195743
86
+ - type: nauc_mrr_at_1000_max
87
+ value: 61.727834175182736
88
+ - type: nauc_mrr_at_1000_std
89
+ value: -2.3231732437794568
90
+ - type: nauc_mrr_at_100_diff1
91
+ value: 76.07916259051902
92
+ - type: nauc_mrr_at_100_max
93
+ value: 61.72703450852774
94
+ - type: nauc_mrr_at_100_std
95
+ value: -2.3175338063349575
96
+ - type: nauc_mrr_at_10_diff1
97
+ value: 75.97996147738112
98
+ - type: nauc_mrr_at_10_max
99
+ value: 61.860784493617224
100
+ - type: nauc_mrr_at_10_std
101
+ value: -2.4887315051072356
102
+ - type: nauc_mrr_at_1_diff1
103
+ value: 78.13561632940586
104
+ - type: nauc_mrr_at_1_max
105
+ value: 59.243520843511746
106
+ - type: nauc_mrr_at_1_std
107
+ value: -2.6689239089679515
108
+ - type: nauc_mrr_at_20_diff1
109
+ value: 76.06883452011327
110
+ - type: nauc_mrr_at_20_max
111
+ value: 61.775589074510826
112
+ - type: nauc_mrr_at_20_std
113
+ value: -2.3905575770447585
114
+ - type: nauc_mrr_at_3_diff1
115
+ value: 75.85937006372846
116
+ - type: nauc_mrr_at_3_max
117
+ value: 61.819093557650895
118
+ - type: nauc_mrr_at_3_std
119
+ value: -2.5207238945764647
120
+ - type: nauc_mrr_at_5_diff1
121
+ value: 76.06929563357589
122
+ - type: nauc_mrr_at_5_max
123
+ value: 61.93563829360039
124
+ - type: nauc_mrr_at_5_std
125
+ value: -1.9424637593671918
126
+ - type: nauc_ndcg_at_1000_diff1
127
+ value: 75.7057240434196
128
+ - type: nauc_ndcg_at_1000_max
129
+ value: 62.021717989510385
130
+ - type: nauc_ndcg_at_1000_std
131
+ value: -2.2522490330905103
132
+ - type: nauc_ndcg_at_100_diff1
133
+ value: 75.62156032414751
134
+ - type: nauc_ndcg_at_100_max
135
+ value: 61.97932968109654
136
+ - type: nauc_ndcg_at_100_std
137
+ value: -2.0118635701265375
138
+ - type: nauc_ndcg_at_10_diff1
139
+ value: 75.09836101324169
140
+ - type: nauc_ndcg_at_10_max
141
+ value: 62.703427209156736
142
+ - type: nauc_ndcg_at_10_std
143
+ value: -2.9287738405282395
144
+ - type: nauc_ndcg_at_1_diff1
145
+ value: 78.13561632940586
146
+ - type: nauc_ndcg_at_1_max
147
+ value: 59.243520843511746
148
+ - type: nauc_ndcg_at_1_std
149
+ value: -2.6689239089679515
150
+ - type: nauc_ndcg_at_20_diff1
151
+ value: 75.46348763248093
152
+ - type: nauc_ndcg_at_20_max
153
+ value: 62.35498579351012
154
+ - type: nauc_ndcg_at_20_std
155
+ value: -2.577338920595739
156
+ - type: nauc_ndcg_at_3_diff1
157
+ value: 74.92773626606146
158
+ - type: nauc_ndcg_at_3_max
159
+ value: 62.55812080913172
160
+ - type: nauc_ndcg_at_3_std
161
+ value: -2.5630879822636476
162
+ - type: nauc_ndcg_at_5_diff1
163
+ value: 75.3100398038724
164
+ - type: nauc_ndcg_at_5_max
165
+ value: 62.81733471459409
166
+ - type: nauc_ndcg_at_5_std
167
+ value: -1.501748019065971
168
+ - type: nauc_precision_at_1000_diff1
169
+ value: .nan
170
+ - type: nauc_precision_at_1000_max
171
+ value: .nan
172
+ - type: nauc_precision_at_1000_std
173
+ value: .nan
174
+ - type: nauc_precision_at_100_diff1
175
+ value: 66.63165266106552
176
+ - type: nauc_precision_at_100_max
177
+ value: 57.60582010582053
178
+ - type: nauc_precision_at_100_std
179
+ value: 23.844537815126937
180
+ - type: nauc_precision_at_10_diff1
181
+ value: 70.08984254109942
182
+ - type: nauc_precision_at_10_max
183
+ value: 67.45880653843606
184
+ - type: nauc_precision_at_10_std
185
+ value: -6.3555626412584
186
+ - type: nauc_precision_at_1_diff1
187
+ value: 78.13561632940586
188
+ - type: nauc_precision_at_1_max
189
+ value: 59.243520843511746
190
+ - type: nauc_precision_at_1_std
191
+ value: -2.6689239089679515
192
+ - type: nauc_precision_at_20_diff1
193
+ value: 71.63306637208878
194
+ - type: nauc_precision_at_20_max
195
+ value: 65.99137307505141
196
+ - type: nauc_precision_at_20_std
197
+ value: -4.675767020423249
198
+ - type: nauc_precision_at_3_diff1
199
+ value: 71.57608769475272
200
+ - type: nauc_precision_at_3_max
201
+ value: 65.10683383365713
202
+ - type: nauc_precision_at_3_std
203
+ value: -2.7514636167292985
204
+ - type: nauc_precision_at_5_diff1
205
+ value: 72.21412151067312
206
+ - type: nauc_precision_at_5_max
207
+ value: 66.43448275862069
208
+ - type: nauc_precision_at_5_std
209
+ value: 0.4555008210180189
210
+ - type: nauc_recall_at_1000_diff1
211
+ value: .nan
212
+ - type: nauc_recall_at_1000_max
213
+ value: .nan
214
+ - type: nauc_recall_at_1000_std
215
+ value: .nan
216
+ - type: nauc_recall_at_100_diff1
217
+ value: 66.63165266106327
218
+ - type: nauc_recall_at_100_max
219
+ value: 57.60582010581922
220
+ - type: nauc_recall_at_100_std
221
+ value: 23.844537815125907
222
+ - type: nauc_recall_at_10_diff1
223
+ value: 70.08984254109967
224
+ - type: nauc_recall_at_10_max
225
+ value: 67.45880653843632
226
+ - type: nauc_recall_at_10_std
227
+ value: -6.355562641258283
228
+ - type: nauc_recall_at_1_diff1
229
+ value: 78.13561632940586
230
+ - type: nauc_recall_at_1_max
231
+ value: 59.243520843511746
232
+ - type: nauc_recall_at_1_std
233
+ value: -2.6689239089679515
234
+ - type: nauc_recall_at_20_diff1
235
+ value: 71.6330663720887
236
+ - type: nauc_recall_at_20_max
237
+ value: 65.9913730750516
238
+ - type: nauc_recall_at_20_std
239
+ value: -4.675767020422999
240
+ - type: nauc_recall_at_3_diff1
241
+ value: 71.57608769475274
242
+ - type: nauc_recall_at_3_max
243
+ value: 65.106833833657
244
+ - type: nauc_recall_at_3_std
245
+ value: -2.7514636167294
246
+ - type: nauc_recall_at_5_diff1
247
+ value: 72.21412151067315
248
+ - type: nauc_recall_at_5_max
249
+ value: 66.43448275862077
250
+ - type: nauc_recall_at_5_std
251
+ value: 0.4555008210180812
252
+ - type: ndcg_at_1
253
+ value: 67.333
254
+ - type: ndcg_at_10
255
+ value: 77.865
256
+ - type: ndcg_at_100
257
+ value: 79.927
258
+ - type: ndcg_at_1000
259
+ value: 80.104
260
+ - type: ndcg_at_20
261
+ value: 78.701
262
+ - type: ndcg_at_3
263
+ value: 74.509
264
+ - type: ndcg_at_5
265
+ value: 76.101
266
+ - type: precision_at_1
267
+ value: 67.333
268
+ - type: precision_at_10
269
+ value: 8.878
270
+ - type: precision_at_100
271
+ value: 0.987
272
+ - type: precision_at_1000
273
+ value: 0.1
274
+ - type: precision_at_20
275
+ value: 4.606
276
+ - type: precision_at_3
277
+ value: 26.480999999999998
278
+ - type: precision_at_5
279
+ value: 16.667
280
+ - type: recall_at_1
281
+ value: 67.333
282
+ - type: recall_at_10
283
+ value: 88.778
284
+ - type: recall_at_100
285
+ value: 98.667
286
+ - type: recall_at_1000
287
+ value: 100.0
288
+ - type: recall_at_20
289
+ value: 92.111
290
+ - type: recall_at_3
291
+ value: 79.444
292
+ - type: recall_at_5
293
+ value: 83.333
294
+ task:
295
+ type: Retrieval
296
+ - dataset:
297
+ config: hun_Latn-eng_Latn
298
+ name: MTEB BelebeleRetrieval (hun_Latn-eng_Latn)
299
+ revision: 75b399394a9803252cfec289d103de462763db7c
300
+ split: test
301
+ type: facebook/belebele
302
+ metrics:
303
+ - type: main_score
304
+ value: 71.307
305
+ - type: map_at_1
306
+ value: 57.778
307
+ - type: map_at_10
308
+ value: 66.843
309
+ - type: map_at_100
310
+ value: 67.368
311
+ - type: map_at_1000
312
+ value: 67.38300000000001
313
+ - type: map_at_20
314
+ value: 67.162
315
+ - type: map_at_3
316
+ value: 64.704
317
+ - type: map_at_5
318
+ value: 65.97
319
+ - type: mrr_at_1
320
+ value: 57.77777777777777
321
+ - type: mrr_at_10
322
+ value: 66.8428130511464
323
+ - type: mrr_at_100
324
+ value: 67.36803803097415
325
+ - type: mrr_at_1000
326
+ value: 67.38317813286176
327
+ - type: mrr_at_20
328
+ value: 67.16164827986293
329
+ - type: mrr_at_3
330
+ value: 64.7037037037037
331
+ - type: mrr_at_5
332
+ value: 65.97037037037038
333
+ - type: nauc_map_at_1000_diff1
334
+ value: 69.02219987684592
335
+ - type: nauc_map_at_1000_max
336
+ value: 60.114123597785785
337
+ - type: nauc_map_at_1000_std
338
+ value: 4.880216382742553
339
+ - type: nauc_map_at_100_diff1
340
+ value: 69.01116363727591
341
+ - type: nauc_map_at_100_max
342
+ value: 60.11716622079215
343
+ - type: nauc_map_at_100_std
344
+ value: 4.890393343425179
345
+ - type: nauc_map_at_10_diff1
346
+ value: 68.95240309900163
347
+ - type: nauc_map_at_10_max
348
+ value: 60.124170478386105
349
+ - type: nauc_map_at_10_std
350
+ value: 4.819161459028938
351
+ - type: nauc_map_at_1_diff1
352
+ value: 72.45335820895522
353
+ - type: nauc_map_at_1_max
354
+ value: 59.127316006176
355
+ - type: nauc_map_at_1_std
356
+ value: 6.580191713844538
357
+ - type: nauc_map_at_20_diff1
358
+ value: 68.87249492072671
359
+ - type: nauc_map_at_20_max
360
+ value: 60.04834608184139
361
+ - type: nauc_map_at_20_std
362
+ value: 4.807958211395879
363
+ - type: nauc_map_at_3_diff1
364
+ value: 69.38092756897547
365
+ - type: nauc_map_at_3_max
366
+ value: 60.30271451423346
367
+ - type: nauc_map_at_3_std
368
+ value: 3.9374045068220322
369
+ - type: nauc_map_at_5_diff1
370
+ value: 69.10875854889262
371
+ - type: nauc_map_at_5_max
372
+ value: 60.24557626138646
373
+ - type: nauc_map_at_5_std
374
+ value: 4.271289591515184
375
+ - type: nauc_mrr_at_1000_diff1
376
+ value: 69.02219987684592
377
+ - type: nauc_mrr_at_1000_max
378
+ value: 60.114123597785785
379
+ - type: nauc_mrr_at_1000_std
380
+ value: 4.880216382742553
381
+ - type: nauc_mrr_at_100_diff1
382
+ value: 69.01116363727591
383
+ - type: nauc_mrr_at_100_max
384
+ value: 60.11716622079215
385
+ - type: nauc_mrr_at_100_std
386
+ value: 4.890393343425179
387
+ - type: nauc_mrr_at_10_diff1
388
+ value: 68.95240309900163
389
+ - type: nauc_mrr_at_10_max
390
+ value: 60.124170478386105
391
+ - type: nauc_mrr_at_10_std
392
+ value: 4.819161459028938
393
+ - type: nauc_mrr_at_1_diff1
394
+ value: 72.45335820895522
395
+ - type: nauc_mrr_at_1_max
396
+ value: 59.127316006176
397
+ - type: nauc_mrr_at_1_std
398
+ value: 6.580191713844538
399
+ - type: nauc_mrr_at_20_diff1
400
+ value: 68.87249492072671
401
+ - type: nauc_mrr_at_20_max
402
+ value: 60.04834608184139
403
+ - type: nauc_mrr_at_20_std
404
+ value: 4.807958211395879
405
+ - type: nauc_mrr_at_3_diff1
406
+ value: 69.38092756897547
407
+ - type: nauc_mrr_at_3_max
408
+ value: 60.30271451423346
409
+ - type: nauc_mrr_at_3_std
410
+ value: 3.9374045068220322
411
+ - type: nauc_mrr_at_5_diff1
412
+ value: 69.10875854889262
413
+ - type: nauc_mrr_at_5_max
414
+ value: 60.24557626138646
415
+ - type: nauc_mrr_at_5_std
416
+ value: 4.271289591515184
417
+ - type: nauc_ndcg_at_1000_diff1
418
+ value: 68.36151731152576
419
+ - type: nauc_ndcg_at_1000_max
420
+ value: 60.21499073164881
421
+ - type: nauc_ndcg_at_1000_std
422
+ value: 5.019374170320369
423
+ - type: nauc_ndcg_at_100_diff1
424
+ value: 68.12777182930174
425
+ - type: nauc_ndcg_at_100_max
426
+ value: 60.293069076013296
427
+ - type: nauc_ndcg_at_100_std
428
+ value: 5.375522795479381
429
+ - type: nauc_ndcg_at_10_diff1
430
+ value: 67.46914440211127
431
+ - type: nauc_ndcg_at_10_max
432
+ value: 60.210209508170976
433
+ - type: nauc_ndcg_at_10_std
434
+ value: 4.921793458534013
435
+ - type: nauc_ndcg_at_1_diff1
436
+ value: 72.45335820895522
437
+ - type: nauc_ndcg_at_1_max
438
+ value: 59.127316006176
439
+ - type: nauc_ndcg_at_1_std
440
+ value: 6.580191713844538
441
+ - type: nauc_ndcg_at_20_diff1
442
+ value: 67.09692054164125
443
+ - type: nauc_ndcg_at_20_max
444
+ value: 59.89689460185056
445
+ - type: nauc_ndcg_at_20_std
446
+ value: 4.977631579372532
447
+ - type: nauc_ndcg_at_3_diff1
448
+ value: 68.54468748113734
449
+ - type: nauc_ndcg_at_3_max
450
+ value: 60.66886257099051
451
+ - type: nauc_ndcg_at_3_std
452
+ value: 3.073807310026356
453
+ - type: nauc_ndcg_at_5_diff1
454
+ value: 67.94441056262235
455
+ - type: nauc_ndcg_at_5_max
456
+ value: 60.47774252804478
457
+ - type: nauc_ndcg_at_5_std
458
+ value: 3.572034464519458
459
+ - type: nauc_precision_at_1000_diff1
460
+ value: .nan
461
+ - type: nauc_precision_at_1000_max
462
+ value: .nan
463
+ - type: nauc_precision_at_1000_std
464
+ value: .nan
465
+ - type: nauc_precision_at_100_diff1
466
+ value: 52.808123249299676
467
+ - type: nauc_precision_at_100_max
468
+ value: 65.81699346405254
469
+ - type: nauc_precision_at_100_std
470
+ value: 31.809056956116383
471
+ - type: nauc_precision_at_10_diff1
472
+ value: 59.02820830750145
473
+ - type: nauc_precision_at_10_max
474
+ value: 60.33787972721626
475
+ - type: nauc_precision_at_10_std
476
+ value: 6.405175213296739
477
+ - type: nauc_precision_at_1_diff1
478
+ value: 72.45335820895522
479
+ - type: nauc_precision_at_1_max
480
+ value: 59.127316006176
481
+ - type: nauc_precision_at_1_std
482
+ value: 6.580191713844538
483
+ - type: nauc_precision_at_20_diff1
484
+ value: 52.242994576107485
485
+ - type: nauc_precision_at_20_max
486
+ value: 57.56617253643015
487
+ - type: nauc_precision_at_20_std
488
+ value: 7.9884388212213455
489
+ - type: nauc_precision_at_3_diff1
490
+ value: 65.73191064426206
491
+ - type: nauc_precision_at_3_max
492
+ value: 61.92373010829596
493
+ - type: nauc_precision_at_3_std
494
+ value: 0.096317142458587
495
+ - type: nauc_precision_at_5_diff1
496
+ value: 63.20464039592358
497
+ - type: nauc_precision_at_5_max
498
+ value: 61.25721735891223
499
+ - type: nauc_precision_at_5_std
500
+ value: 0.7937099220392029
501
+ - type: nauc_recall_at_1000_diff1
502
+ value: .nan
503
+ - type: nauc_recall_at_1000_max
504
+ value: .nan
505
+ - type: nauc_recall_at_1000_std
506
+ value: .nan
507
+ - type: nauc_recall_at_100_diff1
508
+ value: 52.80812324929921
509
+ - type: nauc_recall_at_100_max
510
+ value: 65.81699346405242
511
+ - type: nauc_recall_at_100_std
512
+ value: 31.809056956115235
513
+ - type: nauc_recall_at_10_diff1
514
+ value: 59.02820830750159
515
+ - type: nauc_recall_at_10_max
516
+ value: 60.337879727216446
517
+ - type: nauc_recall_at_10_std
518
+ value: 6.405175213296646
519
+ - type: nauc_recall_at_1_diff1
520
+ value: 72.45335820895522
521
+ - type: nauc_recall_at_1_max
522
+ value: 59.127316006176
523
+ - type: nauc_recall_at_1_std
524
+ value: 6.580191713844538
525
+ - type: nauc_recall_at_20_diff1
526
+ value: 52.242994576107534
527
+ - type: nauc_recall_at_20_max
528
+ value: 57.56617253643034
529
+ - type: nauc_recall_at_20_std
530
+ value: 7.988438821221468
531
+ - type: nauc_recall_at_3_diff1
532
+ value: 65.73191064426209
533
+ - type: nauc_recall_at_3_max
534
+ value: 61.923730108295906
535
+ - type: nauc_recall_at_3_std
536
+ value: 0.09631714245861488
537
+ - type: nauc_recall_at_5_diff1
538
+ value: 63.204640395923626
539
+ - type: nauc_recall_at_5_max
540
+ value: 61.25721735891235
541
+ - type: nauc_recall_at_5_std
542
+ value: 0.7937099220392697
543
+ - type: ndcg_at_1
544
+ value: 57.778
545
+ - type: ndcg_at_10
546
+ value: 71.307
547
+ - type: ndcg_at_100
548
+ value: 73.942
549
+ - type: ndcg_at_1000
550
+ value: 74.248
551
+ - type: ndcg_at_20
552
+ value: 72.499
553
+ - type: ndcg_at_3
554
+ value: 66.95
555
+ - type: ndcg_at_5
556
+ value: 69.21199999999999
557
+ - type: precision_at_1
558
+ value: 57.778
559
+ - type: precision_at_10
560
+ value: 8.533
561
+ - type: precision_at_100
562
+ value: 0.9780000000000001
563
+ - type: precision_at_1000
564
+ value: 0.1
565
+ - type: precision_at_20
566
+ value: 4.506
567
+ - type: precision_at_3
568
+ value: 24.481
569
+ - type: precision_at_5
570
+ value: 15.778
571
+ - type: recall_at_1
572
+ value: 57.778
573
+ - type: recall_at_10
574
+ value: 85.333
575
+ - type: recall_at_100
576
+ value: 97.77799999999999
577
+ - type: recall_at_1000
578
+ value: 100.0
579
+ - type: recall_at_20
580
+ value: 90.11099999999999
581
+ - type: recall_at_3
582
+ value: 73.444
583
+ - type: recall_at_5
584
+ value: 78.889
585
+ task:
586
+ type: Retrieval
587
+ - dataset:
588
+ config: eng_Latn-hun_Latn
589
+ name: MTEB BelebeleRetrieval (eng_Latn-hun_Latn)
590
+ revision: 75b399394a9803252cfec289d103de462763db7c
591
+ split: test
592
+ type: facebook/belebele
593
+ metrics:
594
+ - type: main_score
595
+ value: 73.668
596
+ - type: map_at_1
597
+ value: 60.778
598
+ - type: map_at_10
599
+ value: 69.571
600
+ - type: map_at_100
601
+ value: 70.114
602
+ - type: map_at_1000
603
+ value: 70.124
604
+ - type: map_at_20
605
+ value: 69.93700000000001
606
+ - type: map_at_3
607
+ value: 67.778
608
+ - type: map_at_5
609
+ value: 68.872
610
+ - type: mrr_at_1
611
+ value: 60.77777777777777
612
+ - type: mrr_at_10
613
+ value: 69.57142857142857
614
+ - type: mrr_at_100
615
+ value: 70.1136336675579
616
+ - type: mrr_at_1000
617
+ value: 70.12432347462514
618
+ - type: mrr_at_20
619
+ value: 69.93690215204663
620
+ - type: mrr_at_3
621
+ value: 67.77777777777779
622
+ - type: mrr_at_5
623
+ value: 68.87222222222223
624
+ - type: nauc_map_at_1000_diff1
625
+ value: 70.84789011327231
626
+ - type: nauc_map_at_1000_max
627
+ value: 60.852088181225824
628
+ - type: nauc_map_at_1000_std
629
+ value: 6.549993568212846
630
+ - type: nauc_map_at_100_diff1
631
+ value: 70.84603146007751
632
+ - type: nauc_map_at_100_max
633
+ value: 60.859417397516125
634
+ - type: nauc_map_at_100_std
635
+ value: 6.577244018939677
636
+ - type: nauc_map_at_10_diff1
637
+ value: 70.71490936568583
638
+ - type: nauc_map_at_10_max
639
+ value: 60.94472236517367
640
+ - type: nauc_map_at_10_std
641
+ value: 6.53657697773106
642
+ - type: nauc_map_at_1_diff1
643
+ value: 74.59301032751448
644
+ - type: nauc_map_at_1_max
645
+ value: 59.251209223705935
646
+ - type: nauc_map_at_1_std
647
+ value: 6.536579330592454
648
+ - type: nauc_map_at_20_diff1
649
+ value: 70.69902333418673
650
+ - type: nauc_map_at_20_max
651
+ value: 60.84819592450007
652
+ - type: nauc_map_at_20_std
653
+ value: 6.487171209675751
654
+ - type: nauc_map_at_3_diff1
655
+ value: 70.94073456299253
656
+ - type: nauc_map_at_3_max
657
+ value: 61.117845574972286
658
+ - type: nauc_map_at_3_std
659
+ value: 5.824524654602759
660
+ - type: nauc_map_at_5_diff1
661
+ value: 70.64337838638826
662
+ - type: nauc_map_at_5_max
663
+ value: 60.69375707294804
664
+ - type: nauc_map_at_5_std
665
+ value: 6.1403804587682025
666
+ - type: nauc_mrr_at_1000_diff1
667
+ value: 70.84789011327231
668
+ - type: nauc_mrr_at_1000_max
669
+ value: 60.852088181225824
670
+ - type: nauc_mrr_at_1000_std
671
+ value: 6.549993568212846
672
+ - type: nauc_mrr_at_100_diff1
673
+ value: 70.84603146007751
674
+ - type: nauc_mrr_at_100_max
675
+ value: 60.859417397516125
676
+ - type: nauc_mrr_at_100_std
677
+ value: 6.577244018939677
678
+ - type: nauc_mrr_at_10_diff1
679
+ value: 70.71490936568583
680
+ - type: nauc_mrr_at_10_max
681
+ value: 60.94472236517367
682
+ - type: nauc_mrr_at_10_std
683
+ value: 6.53657697773106
684
+ - type: nauc_mrr_at_1_diff1
685
+ value: 74.59301032751448
686
+ - type: nauc_mrr_at_1_max
687
+ value: 59.251209223705935
688
+ - type: nauc_mrr_at_1_std
689
+ value: 6.536579330592454
690
+ - type: nauc_mrr_at_20_diff1
691
+ value: 70.69902333418673
692
+ - type: nauc_mrr_at_20_max
693
+ value: 60.84819592450007
694
+ - type: nauc_mrr_at_20_std
695
+ value: 6.487171209675751
696
+ - type: nauc_mrr_at_3_diff1
697
+ value: 70.94073456299253
698
+ - type: nauc_mrr_at_3_max
699
+ value: 61.117845574972286
700
+ - type: nauc_mrr_at_3_std
701
+ value: 5.824524654602759
702
+ - type: nauc_mrr_at_5_diff1
703
+ value: 70.64337838638826
704
+ - type: nauc_mrr_at_5_max
705
+ value: 60.69375707294804
706
+ - type: nauc_mrr_at_5_std
707
+ value: 6.1403804587682025
708
+ - type: nauc_ndcg_at_1000_diff1
709
+ value: 70.2568421673153
710
+ - type: nauc_ndcg_at_1000_max
711
+ value: 61.154155762479746
712
+ - type: nauc_ndcg_at_1000_std
713
+ value: 6.987492117976732
714
+ - type: nauc_ndcg_at_100_diff1
715
+ value: 70.23106290886678
716
+ - type: nauc_ndcg_at_100_max
717
+ value: 61.387176821366296
718
+ - type: nauc_ndcg_at_100_std
719
+ value: 7.782749694416603
720
+ - type: nauc_ndcg_at_10_diff1
721
+ value: 69.26227190907855
722
+ - type: nauc_ndcg_at_10_max
723
+ value: 61.634434826859874
724
+ - type: nauc_ndcg_at_10_std
725
+ value: 7.185316156791736
726
+ - type: nauc_ndcg_at_1_diff1
727
+ value: 74.59301032751448
728
+ - type: nauc_ndcg_at_1_max
729
+ value: 59.251209223705935
730
+ - type: nauc_ndcg_at_1_std
731
+ value: 6.536579330592454
732
+ - type: nauc_ndcg_at_20_diff1
733
+ value: 69.1954116973286
734
+ - type: nauc_ndcg_at_20_max
735
+ value: 61.38887961478062
736
+ - type: nauc_ndcg_at_20_std
737
+ value: 7.1318041010309585
738
+ - type: nauc_ndcg_at_3_diff1
739
+ value: 69.75775816678905
740
+ - type: nauc_ndcg_at_3_max
741
+ value: 61.67436817540673
742
+ - type: nauc_ndcg_at_3_std
743
+ value: 5.650531149732009
744
+ - type: nauc_ndcg_at_5_diff1
745
+ value: 69.1651947412561
746
+ - type: nauc_ndcg_at_5_max
747
+ value: 60.97882565960433
748
+ - type: nauc_ndcg_at_5_std
749
+ value: 6.203128058155249
750
+ - type: nauc_precision_at_1000_diff1
751
+ value: .nan
752
+ - type: nauc_precision_at_1000_max
753
+ value: .nan
754
+ - type: nauc_precision_at_1000_std
755
+ value: .nan
756
+ - type: nauc_precision_at_100_diff1
757
+ value: 68.65491294557121
758
+ - type: nauc_precision_at_100_max
759
+ value: 80.36744109408565
760
+ - type: nauc_precision_at_100_std
761
+ value: 70.92327126929257
762
+ - type: nauc_precision_at_10_diff1
763
+ value: 61.29162638094176
764
+ - type: nauc_precision_at_10_max
765
+ value: 65.7264903076506
766
+ - type: nauc_precision_at_10_std
767
+ value: 11.47548778748128
768
+ - type: nauc_precision_at_1_diff1
769
+ value: 74.59301032751448
770
+ - type: nauc_precision_at_1_max
771
+ value: 59.251209223705935
772
+ - type: nauc_precision_at_1_std
773
+ value: 6.536579330592454
774
+ - type: nauc_precision_at_20_diff1
775
+ value: 56.51478369125409
776
+ - type: nauc_precision_at_20_max
777
+ value: 66.28882664176771
778
+ - type: nauc_precision_at_20_std
779
+ value: 14.05415499533146
780
+ - type: nauc_precision_at_3_diff1
781
+ value: 65.55150000975934
782
+ - type: nauc_precision_at_3_max
783
+ value: 63.631594870493636
784
+ - type: nauc_precision_at_3_std
785
+ value: 5.057287295297996
786
+ - type: nauc_precision_at_5_diff1
787
+ value: 62.93787770906014
788
+ - type: nauc_precision_at_5_max
789
+ value: 62.06285784899278
790
+ - type: nauc_precision_at_5_std
791
+ value: 6.577948558011871
792
+ - type: nauc_recall_at_1000_diff1
793
+ value: .nan
794
+ - type: nauc_recall_at_1000_max
795
+ value: .nan
796
+ - type: nauc_recall_at_1000_std
797
+ value: .nan
798
+ - type: nauc_recall_at_100_diff1
799
+ value: 68.6549129455701
800
+ - type: nauc_recall_at_100_max
801
+ value: 80.36744109408454
802
+ - type: nauc_recall_at_100_std
803
+ value: 70.92327126929207
804
+ - type: nauc_recall_at_10_diff1
805
+ value: 61.29162638094184
806
+ - type: nauc_recall_at_10_max
807
+ value: 65.72649030765079
808
+ - type: nauc_recall_at_10_std
809
+ value: 11.475487787481537
810
+ - type: nauc_recall_at_1_diff1
811
+ value: 74.59301032751448
812
+ - type: nauc_recall_at_1_max
813
+ value: 59.251209223705935
814
+ - type: nauc_recall_at_1_std
815
+ value: 6.536579330592454
816
+ - type: nauc_recall_at_20_diff1
817
+ value: 56.514783691254266
818
+ - type: nauc_recall_at_20_max
819
+ value: 66.28882664176774
820
+ - type: nauc_recall_at_20_std
821
+ value: 14.054154995331741
822
+ - type: nauc_recall_at_3_diff1
823
+ value: 65.55150000975928
824
+ - type: nauc_recall_at_3_max
825
+ value: 63.63159487049364
826
+ - type: nauc_recall_at_3_std
827
+ value: 5.05728729529798
828
+ - type: nauc_recall_at_5_diff1
829
+ value: 62.937877709060295
830
+ - type: nauc_recall_at_5_max
831
+ value: 62.06285784899285
832
+ - type: nauc_recall_at_5_std
833
+ value: 6.577948558011953
834
+ - type: ndcg_at_1
835
+ value: 60.778
836
+ - type: ndcg_at_10
837
+ value: 73.668
838
+ - type: ndcg_at_100
839
+ value: 76.21
840
+ - type: ndcg_at_1000
841
+ value: 76.459
842
+ - type: ndcg_at_20
843
+ value: 74.993
844
+ - type: ndcg_at_3
845
+ value: 70.00800000000001
846
+ - type: ndcg_at_5
847
+ value: 71.978
848
+ - type: precision_at_1
849
+ value: 60.778
850
+ - type: precision_at_10
851
+ value: 8.644
852
+ - type: precision_at_100
853
+ value: 0.9809999999999999
854
+ - type: precision_at_1000
855
+ value: 0.1
856
+ - type: precision_at_20
857
+ value: 4.583
858
+ - type: precision_at_3
859
+ value: 25.480999999999998
860
+ - type: precision_at_5
861
+ value: 16.244
862
+ - type: recall_at_1
863
+ value: 60.778
864
+ - type: recall_at_10
865
+ value: 86.444
866
+ - type: recall_at_100
867
+ value: 98.111
868
+ - type: recall_at_1000
869
+ value: 100.0
870
+ - type: recall_at_20
871
+ value: 91.667
872
+ - type: recall_at_3
873
+ value: 76.444
874
+ - type: recall_at_5
875
+ value: 81.22200000000001
876
+ task:
877
+ type: Retrieval
878
+ - dataset:
879
+ config: eng_Latn-hun_Latn
880
+ name: MTEB BibleNLPBitextMining (eng_Latn-hun_Latn)
881
+ revision: 264a18480c529d9e922483839b4b9758e690b762
882
+ split: train
883
+ type: davidstap/biblenlp-corpus-mmteb
884
+ metrics:
885
+ - type: accuracy
886
+ value: 88.671875
887
+ - type: f1
888
+ value: 85.859375
889
+ - type: main_score
890
+ value: 85.859375
891
+ - type: precision
892
+ value: 84.71354166666667
893
+ - type: recall
894
+ value: 88.671875
895
+ task:
896
+ type: BitextMining
897
+ - dataset:
898
+ config: hun_Latn-eng_Latn
899
+ name: MTEB BibleNLPBitextMining (hun_Latn-eng_Latn)
900
+ revision: 264a18480c529d9e922483839b4b9758e690b762
901
+ split: train
902
+ type: davidstap/biblenlp-corpus-mmteb
903
+ metrics:
904
+ - type: accuracy
905
+ value: 91.796875
906
+ - type: f1
907
+ value: 89.41406249999999
908
+ - type: main_score
909
+ value: 89.41406249999999
910
+ - type: precision
911
+ value: 88.31380208333334
912
+ - type: recall
913
+ value: 91.796875
914
+ task:
915
+ type: BitextMining
916
+ - dataset:
917
+ config: default
918
+ name: MTEB HunSum2AbstractiveRetrieval (default)
919
+ revision: 24e1445c8180d937f0a16f8ae8a62e77cc952e56
920
+ split: test
921
+ type: SZTAKI-HLT/HunSum-2-abstractive
922
+ metrics:
923
+ - type: main_score
924
+ value: 63.263000000000005
925
+ - type: map_at_1
926
+ value: 63.263000000000005
927
+ - type: map_at_10
928
+ value: 69.717
929
+ - type: map_at_100
930
+ value: 70.19999999999999
931
+ - type: map_at_1000
932
+ value: 70.223
933
+ - type: map_at_20
934
+ value: 69.987
935
+ - type: map_at_3
936
+ value: 68.126
937
+ - type: map_at_5
938
+ value: 69.11500000000001
939
+ - type: mrr_at_1
940
+ value: 63.263263263263255
941
+ - type: mrr_at_10
942
+ value: 69.71656179989505
943
+ - type: mrr_at_100
944
+ value: 70.20005091433352
945
+ - type: mrr_at_1000
946
+ value: 70.22300238535382
947
+ - type: mrr_at_20
948
+ value: 69.98650484718584
949
+ - type: mrr_at_3
950
+ value: 68.12645979312641
951
+ - type: mrr_at_5
952
+ value: 69.11494828161491
953
+ - type: nauc_map_at_1000_diff1
954
+ value: 78.57062147162597
955
+ - type: nauc_map_at_1000_max
956
+ value: 67.50701502337495
957
+ - type: nauc_map_at_1000_std
958
+ value: -0.5617129044803558
959
+ - type: nauc_map_at_100_diff1
960
+ value: 78.55994402867587
961
+ - type: nauc_map_at_100_max
962
+ value: 67.50751346612932
963
+ - type: nauc_map_at_100_std
964
+ value: -0.5527533150571393
965
+ - type: nauc_map_at_10_diff1
966
+ value: 78.40366721771652
967
+ - type: nauc_map_at_10_max
968
+ value: 67.49241622659412
969
+ - type: nauc_map_at_10_std
970
+ value: -0.48552097268197614
971
+ - type: nauc_map_at_1_diff1
972
+ value: 82.01486923813978
973
+ - type: nauc_map_at_1_max
974
+ value: 65.96265600324601
975
+ - type: nauc_map_at_1_std
976
+ value: -3.3920974069100702
977
+ - type: nauc_map_at_20_diff1
978
+ value: 78.47160921094391
979
+ - type: nauc_map_at_20_max
980
+ value: 67.53010937556571
981
+ - type: nauc_map_at_20_std
982
+ value: -0.5304810036230149
983
+ - type: nauc_map_at_3_diff1
984
+ value: 78.82728109994231
985
+ - type: nauc_map_at_3_max
986
+ value: 67.67886259360823
987
+ - type: nauc_map_at_3_std
988
+ value: -0.8390404611287001
989
+ - type: nauc_map_at_5_diff1
990
+ value: 78.64851152021848
991
+ - type: nauc_map_at_5_max
992
+ value: 67.56443643847581
993
+ - type: nauc_map_at_5_std
994
+ value: -0.5438994708241538
995
+ - type: nauc_mrr_at_1000_diff1
996
+ value: 78.57062147162597
997
+ - type: nauc_mrr_at_1000_max
998
+ value: 67.50701502337495
999
+ - type: nauc_mrr_at_1000_std
1000
+ value: -0.5617129044803558
1001
+ - type: nauc_mrr_at_100_diff1
1002
+ value: 78.55994402867587
1003
+ - type: nauc_mrr_at_100_max
1004
+ value: 67.50751346612932
1005
+ - type: nauc_mrr_at_100_std
1006
+ value: -0.5527533150571393
1007
+ - type: nauc_mrr_at_10_diff1
1008
+ value: 78.40366721771652
1009
+ - type: nauc_mrr_at_10_max
1010
+ value: 67.49241622659412
1011
+ - type: nauc_mrr_at_10_std
1012
+ value: -0.48552097268197614
1013
+ - type: nauc_mrr_at_1_diff1
1014
+ value: 82.01486923813978
1015
+ - type: nauc_mrr_at_1_max
1016
+ value: 65.96265600324601
1017
+ - type: nauc_mrr_at_1_std
1018
+ value: -3.3920974069100702
1019
+ - type: nauc_mrr_at_20_diff1
1020
+ value: 78.47160921094391
1021
+ - type: nauc_mrr_at_20_max
1022
+ value: 67.53010937556571
1023
+ - type: nauc_mrr_at_20_std
1024
+ value: -0.5304810036230149
1025
+ - type: nauc_mrr_at_3_diff1
1026
+ value: 78.82728109994231
1027
+ - type: nauc_mrr_at_3_max
1028
+ value: 67.67886259360823
1029
+ - type: nauc_mrr_at_3_std
1030
+ value: -0.8390404611287001
1031
+ - type: nauc_mrr_at_5_diff1
1032
+ value: 78.64851152021848
1033
+ - type: nauc_mrr_at_5_max
1034
+ value: 67.56443643847581
1035
+ - type: nauc_mrr_at_5_std
1036
+ value: -0.5438994708241538
1037
+ - type: nauc_ndcg_at_1000_diff1
1038
+ value: 77.85313935589254
1039
+ - type: nauc_ndcg_at_1000_max
1040
+ value: 67.79745016701565
1041
+ - type: nauc_ndcg_at_1000_std
1042
+ value: 0.3743893992928968
1043
+ - type: nauc_ndcg_at_100_diff1
1044
+ value: 77.54895730138853
1045
+ - type: nauc_ndcg_at_100_max
1046
+ value: 67.90017248869928
1047
+ - type: nauc_ndcg_at_100_std
1048
+ value: 0.859162358234398
1049
+ - type: nauc_ndcg_at_10_diff1
1050
+ value: 76.71113405671676
1051
+ - type: nauc_ndcg_at_10_max
1052
+ value: 67.96034182778398
1053
+ - type: nauc_ndcg_at_10_std
1054
+ value: 1.1822837192182254
1055
+ - type: nauc_ndcg_at_1_diff1
1056
+ value: 82.01486923813978
1057
+ - type: nauc_ndcg_at_1_max
1058
+ value: 65.96265600324601
1059
+ - type: nauc_ndcg_at_1_std
1060
+ value: -3.3920974069100702
1061
+ - type: nauc_ndcg_at_20_diff1
1062
+ value: 76.93959621702203
1063
+ - type: nauc_ndcg_at_20_max
1064
+ value: 68.11195662698223
1065
+ - type: nauc_ndcg_at_20_std
1066
+ value: 1.04309687394849
1067
+ - type: nauc_ndcg_at_3_diff1
1068
+ value: 77.79565059957739
1069
+ - type: nauc_ndcg_at_3_max
1070
+ value: 68.28729385816999
1071
+ - type: nauc_ndcg_at_3_std
1072
+ value: 0.2325515867720005
1073
+ - type: nauc_ndcg_at_5_diff1
1074
+ value: 77.37740780039985
1075
+ - type: nauc_ndcg_at_5_max
1076
+ value: 68.0591693716456
1077
+ - type: nauc_ndcg_at_5_std
1078
+ value: 0.8419316054801026
1079
+ - type: nauc_precision_at_1000_diff1
1080
+ value: 70.06119288295852
1081
+ - type: nauc_precision_at_1000_max
1082
+ value: 56.300969751588504
1083
+ - type: nauc_precision_at_1000_std
1084
+ value: 42.8131104675957
1085
+ - type: nauc_precision_at_100_diff1
1086
+ value: 67.53252742986358
1087
+ - type: nauc_precision_at_100_max
1088
+ value: 71.63984328411749
1089
+ - type: nauc_precision_at_100_std
1090
+ value: 20.467710864542678
1091
+ - type: nauc_precision_at_10_diff1
1092
+ value: 68.62375685620702
1093
+ - type: nauc_precision_at_10_max
1094
+ value: 70.02532507228068
1095
+ - type: nauc_precision_at_10_std
1096
+ value: 9.35439782317633
1097
+ - type: nauc_precision_at_1_diff1
1098
+ value: 82.01486923813978
1099
+ - type: nauc_precision_at_1_max
1100
+ value: 65.96265600324601
1101
+ - type: nauc_precision_at_1_std
1102
+ value: -3.3920974069100702
1103
+ - type: nauc_precision_at_20_diff1
1104
+ value: 67.96187481073133
1105
+ - type: nauc_precision_at_20_max
1106
+ value: 71.59854027319963
1107
+ - type: nauc_precision_at_20_std
1108
+ value: 10.641909874113086
1109
+ - type: nauc_precision_at_3_diff1
1110
+ value: 74.38802810704372
1111
+ - type: nauc_precision_at_3_max
1112
+ value: 70.31804260818862
1113
+ - type: nauc_precision_at_3_std
1114
+ value: 3.8694413447531946
1115
+ - type: nauc_precision_at_5_diff1
1116
+ value: 72.53680275396366
1117
+ - type: nauc_precision_at_5_max
1118
+ value: 69.84127154759457
1119
+ - type: nauc_precision_at_5_std
1120
+ value: 6.232801743816592
1121
+ - type: nauc_recall_at_1000_diff1
1122
+ value: 70.06119288296337
1123
+ - type: nauc_recall_at_1000_max
1124
+ value: 56.30096975158339
1125
+ - type: nauc_recall_at_1000_std
1126
+ value: 42.81311046760523
1127
+ - type: nauc_recall_at_100_diff1
1128
+ value: 67.53252742986345
1129
+ - type: nauc_recall_at_100_max
1130
+ value: 71.63984328411706
1131
+ - type: nauc_recall_at_100_std
1132
+ value: 20.46771086454334
1133
+ - type: nauc_recall_at_10_diff1
1134
+ value: 68.62375685620707
1135
+ - type: nauc_recall_at_10_max
1136
+ value: 70.02532507228068
1137
+ - type: nauc_recall_at_10_std
1138
+ value: 9.354397823176459
1139
+ - type: nauc_recall_at_1_diff1
1140
+ value: 82.01486923813978
1141
+ - type: nauc_recall_at_1_max
1142
+ value: 65.96265600324601
1143
+ - type: nauc_recall_at_1_std
1144
+ value: -3.3920974069100702
1145
+ - type: nauc_recall_at_20_diff1
1146
+ value: 67.96187481073152
1147
+ - type: nauc_recall_at_20_max
1148
+ value: 71.59854027319979
1149
+ - type: nauc_recall_at_20_std
1150
+ value: 10.641909874113258
1151
+ - type: nauc_recall_at_3_diff1
1152
+ value: 74.3880281070437
1153
+ - type: nauc_recall_at_3_max
1154
+ value: 70.31804260818865
1155
+ - type: nauc_recall_at_3_std
1156
+ value: 3.8694413447530995
1157
+ - type: nauc_recall_at_5_diff1
1158
+ value: 72.53680275396374
1159
+ - type: nauc_recall_at_5_max
1160
+ value: 69.84127154759464
1161
+ - type: nauc_recall_at_5_std
1162
+ value: 6.232801743816686
1163
+ - type: ndcg_at_1
1164
+ value: 63.263000000000005
1165
+ - type: ndcg_at_10
1166
+ value: 72.89099999999999
1167
+ - type: ndcg_at_100
1168
+ value: 75.421
1169
+ - type: ndcg_at_1000
1170
+ value: 76.027
1171
+ - type: ndcg_at_20
1172
+ value: 73.919
1173
+ - type: ndcg_at_3
1174
+ value: 69.646
1175
+ - type: ndcg_at_5
1176
+ value: 71.434
1177
+ - type: precision_at_1
1178
+ value: 63.263000000000005
1179
+ - type: precision_at_10
1180
+ value: 8.288
1181
+ - type: precision_at_100
1182
+ value: 0.95
1183
+ - type: precision_at_1000
1184
+ value: 0.1
1185
+ - type: precision_at_20
1186
+ value: 4.352
1187
+ - type: precision_at_3
1188
+ value: 24.675
1189
+ - type: precision_at_5
1190
+ value: 15.676000000000002
1191
+ - type: recall_at_1
1192
+ value: 63.263000000000005
1193
+ - type: recall_at_10
1194
+ value: 82.883
1195
+ - type: recall_at_100
1196
+ value: 95.045
1197
+ - type: recall_at_1000
1198
+ value: 99.8
1199
+ - type: recall_at_20
1200
+ value: 87.03699999999999
1201
+ - type: recall_at_3
1202
+ value: 74.024
1203
+ - type: recall_at_5
1204
+ value: 78.378
1205
+ task:
1206
+ type: Retrieval
1207
+ - dataset:
1208
+ config: hu
1209
+ name: MTEB MassiveIntentClassification (hu)
1210
+ revision: 4672e20407010da34463acc759c162ca9734bca6
1211
+ split: test
1212
+ type: mteb/amazon_massive_intent
1213
+ metrics:
1214
+ - type: accuracy
1215
+ value: 60.08406186953599
1216
+ - type: f1
1217
+ value: 56.958742875652455
1218
+ - type: f1_weighted
1219
+ value: 60.57068245324919
1220
+ - type: main_score
1221
+ value: 60.08406186953599
1222
+ task:
1223
+ type: Classification
1224
+ - dataset:
1225
+ config: hu
1226
+ name: MTEB MassiveIntentClassification (hu)
1227
+ revision: 4672e20407010da34463acc759c162ca9734bca6
1228
+ split: validation
1229
+ type: mteb/amazon_massive_intent
1230
+ metrics:
1231
+ - type: accuracy
1232
+ value: 60.201672405312344
1233
+ - type: f1
1234
+ value: 57.03816512332761
1235
+ - type: f1_weighted
1236
+ value: 60.53109947438201
1237
+ - type: main_score
1238
+ value: 60.201672405312344
1239
+ task:
1240
+ type: Classification
1241
+ - dataset:
1242
+ config: hu
1243
+ name: MTEB MassiveScenarioClassification (hu)
1244
+ revision: fad2c6e8459f9e1c45d9315f4953d921437d70f8
1245
+ split: test
1246
+ type: mteb/amazon_massive_scenario
1247
+ metrics:
1248
+ - type: accuracy
1249
+ value: 66.61398789509079
1250
+ - type: f1
1251
+ value: 65.88647044935249
1252
+ - type: f1_weighted
1253
+ value: 66.80145146976484
1254
+ - type: main_score
1255
+ value: 66.61398789509079
1256
+ task:
1257
+ type: Classification
1258
+ - dataset:
1259
+ config: hu
1260
+ name: MTEB MassiveScenarioClassification (hu)
1261
+ revision: fad2c6e8459f9e1c45d9315f4953d921437d70f8
1262
+ split: validation
1263
+ type: mteb/amazon_massive_scenario
1264
+ metrics:
1265
+ - type: accuracy
1266
+ value: 66.11411706837187
1267
+ - type: f1
1268
+ value: 65.76717397996951
1269
+ - type: f1_weighted
1270
+ value: 66.29902597756885
1271
+ - type: main_score
1272
+ value: 66.11411706837187
1273
+ task:
1274
+ type: Classification
1275
+ - dataset:
1276
+ config: hu
1277
+ name: MTEB MultiEURLEXMultilabelClassification (hu)
1278
+ revision: 2aea5a6dc8fdcfeca41d0fb963c0a338930bde5c
1279
+ split: test
1280
+ type: mteb/eurlex-multilingual
1281
+ metrics:
1282
+ - type: accuracy
1283
+ value: 3.0839999999999996
1284
+ - type: f1
1285
+ value: 27.860225486785566
1286
+ - type: lrap
1287
+ value: 43.02579150793552
1288
+ - type: main_score
1289
+ value: 3.0839999999999996
1290
+ task:
1291
+ type: MultilabelClassification
1292
+ - dataset:
1293
+ config: arb_Arab-hun_Latn
1294
+ name: MTEB NTREXBitextMining (arb_Arab-hun_Latn)
1295
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1296
+ split: test
1297
+ type: mteb/NTREX
1298
+ metrics:
1299
+ - type: accuracy
1300
+ value: 85.678517776665
1301
+ - type: f1
1302
+ value: 81.92049979731502
1303
+ - type: main_score
1304
+ value: 81.92049979731502
1305
+ - type: precision
1306
+ value: 80.21115005842097
1307
+ - type: recall
1308
+ value: 85.678517776665
1309
+ task:
1310
+ type: BitextMining
1311
+ - dataset:
1312
+ config: ben_Beng-hun_Latn
1313
+ name: MTEB NTREXBitextMining (ben_Beng-hun_Latn)
1314
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1315
+ split: test
1316
+ type: mteb/NTREX
1317
+ metrics:
1318
+ - type: accuracy
1319
+ value: 44.566850275413124
1320
+ - type: f1
1321
+ value: 39.07033025889276
1322
+ - type: main_score
1323
+ value: 39.07033025889276
1324
+ - type: precision
1325
+ value: 37.07348327291399
1326
+ - type: recall
1327
+ value: 44.566850275413124
1328
+ task:
1329
+ type: BitextMining
1330
+ - dataset:
1331
+ config: deu_Latn-hun_Latn
1332
+ name: MTEB NTREXBitextMining (deu_Latn-hun_Latn)
1333
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1334
+ split: test
1335
+ type: mteb/NTREX
1336
+ metrics:
1337
+ - type: accuracy
1338
+ value: 93.44016024036054
1339
+ - type: f1
1340
+ value: 91.61909530963112
1341
+ - type: main_score
1342
+ value: 91.61909530963112
1343
+ - type: precision
1344
+ value: 90.75279586045735
1345
+ - type: recall
1346
+ value: 93.44016024036054
1347
+ task:
1348
+ type: BitextMining
1349
+ - dataset:
1350
+ config: ell_Grek-hun_Latn
1351
+ name: MTEB NTREXBitextMining (ell_Grek-hun_Latn)
1352
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1353
+ split: test
1354
+ type: mteb/NTREX
1355
+ metrics:
1356
+ - type: accuracy
1357
+ value: 91.4371557336004
1358
+ - type: f1
1359
+ value: 89.0261582850466
1360
+ - type: main_score
1361
+ value: 89.0261582850466
1362
+ - type: precision
1363
+ value: 87.9043565348022
1364
+ - type: recall
1365
+ value: 91.4371557336004
1366
+ task:
1367
+ type: BitextMining
1368
+ - dataset:
1369
+ config: eng_Latn-hun_Latn
1370
+ name: MTEB NTREXBitextMining (eng_Latn-hun_Latn)
1371
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1372
+ split: test
1373
+ type: mteb/NTREX
1374
+ metrics:
1375
+ - type: accuracy
1376
+ value: 94.44166249374061
1377
+ - type: f1
1378
+ value: 92.8092138207311
1379
+ - type: main_score
1380
+ value: 92.8092138207311
1381
+ - type: precision
1382
+ value: 92.0422300116842
1383
+ - type: recall
1384
+ value: 94.44166249374061
1385
+ task:
1386
+ type: BitextMining
1387
+ - dataset:
1388
+ config: fas_Arab-hun_Latn
1389
+ name: MTEB NTREXBitextMining (fas_Arab-hun_Latn)
1390
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1391
+ split: test
1392
+ type: mteb/NTREX
1393
+ metrics:
1394
+ - type: accuracy
1395
+ value: 89.53430145217827
1396
+ - type: f1
1397
+ value: 86.72270310227245
1398
+ - type: main_score
1399
+ value: 86.72270310227245
1400
+ - type: precision
1401
+ value: 85.42814221331997
1402
+ - type: recall
1403
+ value: 89.53430145217827
1404
+ task:
1405
+ type: BitextMining
1406
+ - dataset:
1407
+ config: fin_Latn-hun_Latn
1408
+ name: MTEB NTREXBitextMining (fin_Latn-hun_Latn)
1409
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1410
+ split: test
1411
+ type: mteb/NTREX
1412
+ metrics:
1413
+ - type: accuracy
1414
+ value: 90.98647971957938
1415
+ - type: f1
1416
+ value: 88.44600233683859
1417
+ - type: main_score
1418
+ value: 88.44600233683859
1419
+ - type: precision
1420
+ value: 87.2575529961609
1421
+ - type: recall
1422
+ value: 90.98647971957938
1423
+ task:
1424
+ type: BitextMining
1425
+ - dataset:
1426
+ config: fra_Latn-hun_Latn
1427
+ name: MTEB NTREXBitextMining (fra_Latn-hun_Latn)
1428
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1429
+ split: test
1430
+ type: mteb/NTREX
1431
+ metrics:
1432
+ - type: accuracy
1433
+ value: 92.28843264897347
1434
+ - type: f1
1435
+ value: 90.12518778167251
1436
+ - type: main_score
1437
+ value: 90.12518778167251
1438
+ - type: precision
1439
+ value: 89.12535469871473
1440
+ - type: recall
1441
+ value: 92.28843264897347
1442
+ task:
1443
+ type: BitextMining
1444
+ - dataset:
1445
+ config: heb_Hebr-hun_Latn
1446
+ name: MTEB NTREXBitextMining (heb_Hebr-hun_Latn)
1447
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1448
+ split: test
1449
+ type: mteb/NTREX
1450
+ metrics:
1451
+ - type: accuracy
1452
+ value: 87.33099649474211
1453
+ - type: f1
1454
+ value: 83.88582874311467
1455
+ - type: main_score
1456
+ value: 83.88582874311467
1457
+ - type: precision
1458
+ value: 82.31263562009681
1459
+ - type: recall
1460
+ value: 87.33099649474211
1461
+ task:
1462
+ type: BitextMining
1463
+ - dataset:
1464
+ config: hin_Deva-hun_Latn
1465
+ name: MTEB NTREXBitextMining (hin_Deva-hun_Latn)
1466
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1467
+ split: test
1468
+ type: mteb/NTREX
1469
+ metrics:
1470
+ - type: accuracy
1471
+ value: 86.52979469203805
1472
+ - type: f1
1473
+ value: 83.08240137984755
1474
+ - type: main_score
1475
+ value: 83.08240137984755
1476
+ - type: precision
1477
+ value: 81.51352028042064
1478
+ - type: recall
1479
+ value: 86.52979469203805
1480
+ task:
1481
+ type: BitextMining
1482
+ - dataset:
1483
+ config: hun_Latn-arb_Arab
1484
+ name: MTEB NTREXBitextMining (hun_Latn-arb_Arab)
1485
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1486
+ split: test
1487
+ type: mteb/NTREX
1488
+ metrics:
1489
+ - type: accuracy
1490
+ value: 86.73009514271406
1491
+ - type: f1
1492
+ value: 83.12397167179341
1493
+ - type: main_score
1494
+ value: 83.12397167179341
1495
+ - type: precision
1496
+ value: 81.47805040894676
1497
+ - type: recall
1498
+ value: 86.73009514271406
1499
+ task:
1500
+ type: BitextMining
1501
+ - dataset:
1502
+ config: hun_Latn-ben_Beng
1503
+ name: MTEB NTREXBitextMining (hun_Latn-ben_Beng)
1504
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1505
+ split: test
1506
+ type: mteb/NTREX
1507
+ metrics:
1508
+ - type: accuracy
1509
+ value: 41.16174261392088
1510
+ - type: f1
1511
+ value: 32.73025519520262
1512
+ - type: main_score
1513
+ value: 32.73025519520262
1514
+ - type: precision
1515
+ value: 29.859172986363774
1516
+ - type: recall
1517
+ value: 41.16174261392088
1518
+ task:
1519
+ type: BitextMining
1520
+ - dataset:
1521
+ config: hun_Latn-deu_Latn
1522
+ name: MTEB NTREXBitextMining (hun_Latn-deu_Latn)
1523
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1524
+ split: test
1525
+ type: mteb/NTREX
1526
+ metrics:
1527
+ - type: accuracy
1528
+ value: 93.39008512769153
1529
+ - type: f1
1530
+ value: 91.5456518110499
1531
+ - type: main_score
1532
+ value: 91.5456518110499
1533
+ - type: precision
1534
+ value: 90.66099148723085
1535
+ - type: recall
1536
+ value: 93.39008512769153
1537
+ task:
1538
+ type: BitextMining
1539
+ - dataset:
1540
+ config: hun_Latn-ell_Grek
1541
+ name: MTEB NTREXBitextMining (hun_Latn-ell_Grek)
1542
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1543
+ split: test
1544
+ type: mteb/NTREX
1545
+ metrics:
1546
+ - type: accuracy
1547
+ value: 92.03805708562844
1548
+ - type: f1
1549
+ value: 89.81305291270239
1550
+ - type: main_score
1551
+ value: 89.81305291270239
1552
+ - type: precision
1553
+ value: 88.78317476214322
1554
+ - type: recall
1555
+ value: 92.03805708562844
1556
+ task:
1557
+ type: BitextMining
1558
+ - dataset:
1559
+ config: hun_Latn-eng_Latn
1560
+ name: MTEB NTREXBitextMining (hun_Latn-eng_Latn)
1561
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1562
+ split: test
1563
+ type: mteb/NTREX
1564
+ metrics:
1565
+ - type: accuracy
1566
+ value: 94.74211316975463
1567
+ - type: f1
1568
+ value: 93.23985978968453
1569
+ - type: main_score
1570
+ value: 93.23985978968453
1571
+ - type: precision
1572
+ value: 92.51377065598398
1573
+ - type: recall
1574
+ value: 94.74211316975463
1575
+ task:
1576
+ type: BitextMining
1577
+ - dataset:
1578
+ config: hun_Latn-fas_Arab
1579
+ name: MTEB NTREXBitextMining (hun_Latn-fas_Arab)
1580
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1581
+ split: test
1582
+ type: mteb/NTREX
1583
+ metrics:
1584
+ - type: accuracy
1585
+ value: 88.5327991987982
1586
+ - type: f1
1587
+ value: 85.49240527457853
1588
+ - type: main_score
1589
+ value: 85.49240527457853
1590
+ - type: precision
1591
+ value: 84.10413238905979
1592
+ - type: recall
1593
+ value: 88.5327991987982
1594
+ task:
1595
+ type: BitextMining
1596
+ - dataset:
1597
+ config: hun_Latn-fin_Latn
1598
+ name: MTEB NTREXBitextMining (hun_Latn-fin_Latn)
1599
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1600
+ split: test
1601
+ type: mteb/NTREX
1602
+ metrics:
1603
+ - type: accuracy
1604
+ value: 90.23535302954431
1605
+ - type: f1
1606
+ value: 87.53296611584042
1607
+ - type: main_score
1608
+ value: 87.53296611584042
1609
+ - type: precision
1610
+ value: 86.26690035052579
1611
+ - type: recall
1612
+ value: 90.23535302954431
1613
+ task:
1614
+ type: BitextMining
1615
+ - dataset:
1616
+ config: hun_Latn-fra_Latn
1617
+ name: MTEB NTREXBitextMining (hun_Latn-fra_Latn)
1618
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1619
+ split: test
1620
+ type: mteb/NTREX
1621
+ metrics:
1622
+ - type: accuracy
1623
+ value: 92.63895843765648
1624
+ - type: f1
1625
+ value: 90.47070605908863
1626
+ - type: main_score
1627
+ value: 90.47070605908863
1628
+ - type: precision
1629
+ value: 89.42163244867301
1630
+ - type: recall
1631
+ value: 92.63895843765648
1632
+ task:
1633
+ type: BitextMining
1634
+ - dataset:
1635
+ config: hun_Latn-heb_Hebr
1636
+ name: MTEB NTREXBitextMining (hun_Latn-heb_Hebr)
1637
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1638
+ split: test
1639
+ type: mteb/NTREX
1640
+ metrics:
1641
+ - type: accuracy
1642
+ value: 86.62994491737606
1643
+ - type: f1
1644
+ value: 83.19388173168845
1645
+ - type: main_score
1646
+ value: 83.19388173168845
1647
+ - type: precision
1648
+ value: 81.65832081455517
1649
+ - type: recall
1650
+ value: 86.62994491737606
1651
+ task:
1652
+ type: BitextMining
1653
+ - dataset:
1654
+ config: hun_Latn-hin_Deva
1655
+ name: MTEB NTREXBitextMining (hun_Latn-hin_Deva)
1656
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1657
+ split: test
1658
+ type: mteb/NTREX
1659
+ metrics:
1660
+ - type: accuracy
1661
+ value: 83.97596394591888
1662
+ - type: f1
1663
+ value: 79.85502062617736
1664
+ - type: main_score
1665
+ value: 79.85502062617736
1666
+ - type: precision
1667
+ value: 78.01758192844824
1668
+ - type: recall
1669
+ value: 83.97596394591888
1670
+ task:
1671
+ type: BitextMining
1672
+ - dataset:
1673
+ config: hun_Latn-ind_Latn
1674
+ name: MTEB NTREXBitextMining (hun_Latn-ind_Latn)
1675
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1676
+ split: test
1677
+ type: mteb/NTREX
1678
+ metrics:
1679
+ - type: accuracy
1680
+ value: 92.68903355032549
1681
+ - type: f1
1682
+ value: 90.64596895343014
1683
+ - type: main_score
1684
+ value: 90.64596895343014
1685
+ - type: precision
1686
+ value: 89.68869971624103
1687
+ - type: recall
1688
+ value: 92.68903355032549
1689
+ task:
1690
+ type: BitextMining
1691
+ - dataset:
1692
+ config: hun_Latn-jpn_Jpan
1693
+ name: MTEB NTREXBitextMining (hun_Latn-jpn_Jpan)
1694
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1695
+ split: test
1696
+ type: mteb/NTREX
1697
+ metrics:
1698
+ - type: accuracy
1699
+ value: 85.778668002003
1700
+ - type: f1
1701
+ value: 82.19829744616925
1702
+ - type: main_score
1703
+ value: 82.19829744616925
1704
+ - type: precision
1705
+ value: 80.62426973794025
1706
+ - type: recall
1707
+ value: 85.778668002003
1708
+ task:
1709
+ type: BitextMining
1710
+ - dataset:
1711
+ config: hun_Latn-kor_Hang
1712
+ name: MTEB NTREXBitextMining (hun_Latn-kor_Hang)
1713
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1714
+ split: test
1715
+ type: mteb/NTREX
1716
+ metrics:
1717
+ - type: accuracy
1718
+ value: 84.17626439659489
1719
+ - type: f1
1720
+ value: 80.26746468909714
1721
+ - type: main_score
1722
+ value: 80.26746468909714
1723
+ - type: precision
1724
+ value: 78.5646097351155
1725
+ - type: recall
1726
+ value: 84.17626439659489
1727
+ task:
1728
+ type: BitextMining
1729
+ - dataset:
1730
+ config: hun_Latn-lav_Latn
1731
+ name: MTEB NTREXBitextMining (hun_Latn-lav_Latn)
1732
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1733
+ split: test
1734
+ type: mteb/NTREX
1735
+ metrics:
1736
+ - type: accuracy
1737
+ value: 90.1352028042063
1738
+ - type: f1
1739
+ value: 87.30262059756302
1740
+ - type: main_score
1741
+ value: 87.30262059756302
1742
+ - type: precision
1743
+ value: 85.98731430479052
1744
+ - type: recall
1745
+ value: 90.1352028042063
1746
+ task:
1747
+ type: BitextMining
1748
+ - dataset:
1749
+ config: hun_Latn-lit_Latn
1750
+ name: MTEB NTREXBitextMining (hun_Latn-lit_Latn)
1751
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1752
+ split: test
1753
+ type: mteb/NTREX
1754
+ metrics:
1755
+ - type: accuracy
1756
+ value: 89.58437656484726
1757
+ - type: f1
1758
+ value: 86.8252378567852
1759
+ - type: main_score
1760
+ value: 86.8252378567852
1761
+ - type: precision
1762
+ value: 85.54581872809214
1763
+ - type: recall
1764
+ value: 89.58437656484726
1765
+ task:
1766
+ type: BitextMining
1767
+ - dataset:
1768
+ config: hun_Latn-nld_Latn
1769
+ name: MTEB NTREXBitextMining (hun_Latn-nld_Latn)
1770
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1771
+ split: test
1772
+ type: mteb/NTREX
1773
+ metrics:
1774
+ - type: accuracy
1775
+ value: 93.03955933900852
1776
+ - type: f1
1777
+ value: 91.03989317309296
1778
+ - type: main_score
1779
+ value: 91.03989317309296
1780
+ - type: precision
1781
+ value: 90.08930061759305
1782
+ - type: recall
1783
+ value: 93.03955933900852
1784
+ task:
1785
+ type: BitextMining
1786
+ - dataset:
1787
+ config: hun_Latn-pol_Latn
1788
+ name: MTEB NTREXBitextMining (hun_Latn-pol_Latn)
1789
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1790
+ split: test
1791
+ type: mteb/NTREX
1792
+ metrics:
1793
+ - type: accuracy
1794
+ value: 91.58738107160741
1795
+ - type: f1
1796
+ value: 89.28225671841095
1797
+ - type: main_score
1798
+ value: 89.28225671841095
1799
+ - type: precision
1800
+ value: 88.18227341011517
1801
+ - type: recall
1802
+ value: 91.58738107160741
1803
+ task:
1804
+ type: BitextMining
1805
+ - dataset:
1806
+ config: hun_Latn-por_Latn
1807
+ name: MTEB NTREXBitextMining (hun_Latn-por_Latn)
1808
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1809
+ split: test
1810
+ type: mteb/NTREX
1811
+ metrics:
1812
+ - type: accuracy
1813
+ value: 93.59038557836755
1814
+ - type: f1
1815
+ value: 91.71256885327992
1816
+ - type: main_score
1817
+ value: 91.71256885327992
1818
+ - type: precision
1819
+ value: 90.80287097312635
1820
+ - type: recall
1821
+ value: 93.59038557836755
1822
+ task:
1823
+ type: BitextMining
1824
+ - dataset:
1825
+ config: hun_Latn-rus_Cyrl
1826
+ name: MTEB NTREXBitextMining (hun_Latn-rus_Cyrl)
1827
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1828
+ split: test
1829
+ type: mteb/NTREX
1830
+ metrics:
1831
+ - type: accuracy
1832
+ value: 91.3370055082624
1833
+ - type: f1
1834
+ value: 88.88916708395926
1835
+ - type: main_score
1836
+ value: 88.88916708395926
1837
+ - type: precision
1838
+ value: 87.75961561389704
1839
+ - type: recall
1840
+ value: 91.3370055082624
1841
+ task:
1842
+ type: BitextMining
1843
+ - dataset:
1844
+ config: hun_Latn-spa_Latn
1845
+ name: MTEB NTREXBitextMining (hun_Latn-spa_Latn)
1846
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1847
+ split: test
1848
+ type: mteb/NTREX
1849
+ metrics:
1850
+ - type: accuracy
1851
+ value: 93.69053580370556
1852
+ - type: f1
1853
+ value: 91.94959105324652
1854
+ - type: main_score
1855
+ value: 91.94959105324652
1856
+ - type: precision
1857
+ value: 91.12418627941913
1858
+ - type: recall
1859
+ value: 93.69053580370556
1860
+ task:
1861
+ type: BitextMining
1862
+ - dataset:
1863
+ config: hun_Latn-swa_Latn
1864
+ name: MTEB NTREXBitextMining (hun_Latn-swa_Latn)
1865
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1866
+ split: test
1867
+ type: mteb/NTREX
1868
+ metrics:
1869
+ - type: accuracy
1870
+ value: 35.803705558337505
1871
+ - type: f1
1872
+ value: 27.79832969518814
1873
+ - type: main_score
1874
+ value: 27.79832969518814
1875
+ - type: precision
1876
+ value: 25.370895920971037
1877
+ - type: recall
1878
+ value: 35.803705558337505
1879
+ task:
1880
+ type: BitextMining
1881
+ - dataset:
1882
+ config: hun_Latn-swe_Latn
1883
+ name: MTEB NTREXBitextMining (hun_Latn-swe_Latn)
1884
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1885
+ split: test
1886
+ type: mteb/NTREX
1887
+ metrics:
1888
+ - type: accuracy
1889
+ value: 93.59038557836755
1890
+ - type: f1
1891
+ value: 91.66249374061091
1892
+ - type: main_score
1893
+ value: 91.66249374061091
1894
+ - type: precision
1895
+ value: 90.74445000834585
1896
+ - type: recall
1897
+ value: 93.59038557836755
1898
+ task:
1899
+ type: BitextMining
1900
+ - dataset:
1901
+ config: hun_Latn-tam_Taml
1902
+ name: MTEB NTREXBitextMining (hun_Latn-tam_Taml)
1903
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1904
+ split: test
1905
+ type: mteb/NTREX
1906
+ metrics:
1907
+ - type: accuracy
1908
+ value: 27.391086629944915
1909
+ - type: f1
1910
+ value: 19.094552675413095
1911
+ - type: main_score
1912
+ value: 19.094552675413095
1913
+ - type: precision
1914
+ value: 16.88288208814635
1915
+ - type: recall
1916
+ value: 27.391086629944915
1917
+ task:
1918
+ type: BitextMining
1919
+ - dataset:
1920
+ config: hun_Latn-tur_Latn
1921
+ name: MTEB NTREXBitextMining (hun_Latn-tur_Latn)
1922
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1923
+ split: test
1924
+ type: mteb/NTREX
1925
+ metrics:
1926
+ - type: accuracy
1927
+ value: 91.48723084626941
1928
+ - type: f1
1929
+ value: 89.11700884660323
1930
+ - type: main_score
1931
+ value: 89.11700884660323
1932
+ - type: precision
1933
+ value: 87.99031881155067
1934
+ - type: recall
1935
+ value: 91.48723084626941
1936
+ task:
1937
+ type: BitextMining
1938
+ - dataset:
1939
+ config: hun_Latn-vie_Latn
1940
+ name: MTEB NTREXBitextMining (hun_Latn-vie_Latn)
1941
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1942
+ split: test
1943
+ type: mteb/NTREX
1944
+ metrics:
1945
+ - type: accuracy
1946
+ value: 91.13670505758637
1947
+ - type: f1
1948
+ value: 88.6696711734268
1949
+ - type: main_score
1950
+ value: 88.6696711734268
1951
+ - type: precision
1952
+ value: 87.49374061091638
1953
+ - type: recall
1954
+ value: 91.13670505758637
1955
+ task:
1956
+ type: BitextMining
1957
+ - dataset:
1958
+ config: hun_Latn-zho_Hant
1959
+ name: MTEB NTREXBitextMining (hun_Latn-zho_Hant)
1960
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1961
+ split: test
1962
+ type: mteb/NTREX
1963
+ metrics:
1964
+ - type: accuracy
1965
+ value: 89.33400100150224
1966
+ - type: f1
1967
+ value: 86.55745523046474
1968
+ - type: main_score
1969
+ value: 86.55745523046474
1970
+ - type: precision
1971
+ value: 85.29794692038057
1972
+ - type: recall
1973
+ value: 89.33400100150224
1974
+ task:
1975
+ type: BitextMining
1976
+ - dataset:
1977
+ config: hun_Latn-zul_Latn
1978
+ name: MTEB NTREXBitextMining (hun_Latn-zul_Latn)
1979
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1980
+ split: test
1981
+ type: mteb/NTREX
1982
+ metrics:
1983
+ - type: accuracy
1984
+ value: 16.675012518778168
1985
+ - type: f1
1986
+ value: 11.21636405139599
1987
+ - type: main_score
1988
+ value: 11.21636405139599
1989
+ - type: precision
1990
+ value: 9.903070059112947
1991
+ - type: recall
1992
+ value: 16.675012518778168
1993
+ task:
1994
+ type: BitextMining
1995
+ - dataset:
1996
+ config: ind_Latn-hun_Latn
1997
+ name: MTEB NTREXBitextMining (ind_Latn-hun_Latn)
1998
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1999
+ split: test
2000
+ type: mteb/NTREX
2001
+ metrics:
2002
+ - type: accuracy
2003
+ value: 92.93940911367051
2004
+ - type: f1
2005
+ value: 90.96478050408946
2006
+ - type: main_score
2007
+ value: 90.96478050408946
2008
+ - type: precision
2009
+ value: 90.03922550492406
2010
+ - type: recall
2011
+ value: 92.93940911367051
2012
+ task:
2013
+ type: BitextMining
2014
+ - dataset:
2015
+ config: jpn_Jpan-hun_Latn
2016
+ name: MTEB NTREXBitextMining (jpn_Jpan-hun_Latn)
2017
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2018
+ split: test
2019
+ type: mteb/NTREX
2020
+ metrics:
2021
+ - type: accuracy
2022
+ value: 88.28242363545317
2023
+ - type: f1
2024
+ value: 85.11433817392756
2025
+ - type: main_score
2026
+ value: 85.11433817392756
2027
+ - type: precision
2028
+ value: 83.67551326990485
2029
+ - type: recall
2030
+ value: 88.28242363545317
2031
+ task:
2032
+ type: BitextMining
2033
+ - dataset:
2034
+ config: kor_Hang-hun_Latn
2035
+ name: MTEB NTREXBitextMining (kor_Hang-hun_Latn)
2036
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2037
+ split: test
2038
+ type: mteb/NTREX
2039
+ metrics:
2040
+ - type: accuracy
2041
+ value: 85.778668002003
2042
+ - type: f1
2043
+ value: 81.83608746453012
2044
+ - type: main_score
2045
+ value: 81.83608746453012
2046
+ - type: precision
2047
+ value: 80.0233683859122
2048
+ - type: recall
2049
+ value: 85.778668002003
2050
+ task:
2051
+ type: BitextMining
2052
+ - dataset:
2053
+ config: lav_Latn-hun_Latn
2054
+ name: MTEB NTREXBitextMining (lav_Latn-hun_Latn)
2055
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2056
+ split: test
2057
+ type: mteb/NTREX
2058
+ metrics:
2059
+ - type: accuracy
2060
+ value: 91.73760640961443
2061
+ - type: f1
2062
+ value: 89.42914371557336
2063
+ - type: main_score
2064
+ value: 89.42914371557336
2065
+ - type: precision
2066
+ value: 88.32832582206642
2067
+ - type: recall
2068
+ value: 91.73760640961443
2069
+ task:
2070
+ type: BitextMining
2071
+ - dataset:
2072
+ config: lit_Latn-hun_Latn
2073
+ name: MTEB NTREXBitextMining (lit_Latn-hun_Latn)
2074
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2075
+ split: test
2076
+ type: mteb/NTREX
2077
+ metrics:
2078
+ - type: accuracy
2079
+ value: 91.78768152228342
2080
+ - type: f1
2081
+ value: 89.50926389584376
2082
+ - type: main_score
2083
+ value: 89.50926389584376
2084
+ - type: precision
2085
+ value: 88.39926556501419
2086
+ - type: recall
2087
+ value: 91.78768152228342
2088
+ task:
2089
+ type: BitextMining
2090
+ - dataset:
2091
+ config: nld_Latn-hun_Latn
2092
+ name: MTEB NTREXBitextMining (nld_Latn-hun_Latn)
2093
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2094
+ split: test
2095
+ type: mteb/NTREX
2096
+ metrics:
2097
+ - type: accuracy
2098
+ value: 93.49023535302955
2099
+ - type: f1
2100
+ value: 91.6190953096311
2101
+ - type: main_score
2102
+ value: 91.6190953096311
2103
+ - type: precision
2104
+ value: 90.72775830412286
2105
+ - type: recall
2106
+ value: 93.49023535302955
2107
+ task:
2108
+ type: BitextMining
2109
+ - dataset:
2110
+ config: pol_Latn-hun_Latn
2111
+ name: MTEB NTREXBitextMining (pol_Latn-hun_Latn)
2112
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2113
+ split: test
2114
+ type: mteb/NTREX
2115
+ metrics:
2116
+ - type: accuracy
2117
+ value: 91.28693039559339
2118
+ - type: f1
2119
+ value: 88.99515940577533
2120
+ - type: main_score
2121
+ value: 88.99515940577533
2122
+ - type: precision
2123
+ value: 87.9293940911367
2124
+ - type: recall
2125
+ value: 91.28693039559339
2126
+ task:
2127
+ type: BitextMining
2128
+ - dataset:
2129
+ config: por_Latn-hun_Latn
2130
+ name: MTEB NTREXBitextMining (por_Latn-hun_Latn)
2131
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2132
+ split: test
2133
+ type: mteb/NTREX
2134
+ metrics:
2135
+ - type: accuracy
2136
+ value: 93.03955933900852
2137
+ - type: f1
2138
+ value: 91.08496077449509
2139
+ - type: main_score
2140
+ value: 91.08496077449509
2141
+ - type: precision
2142
+ value: 90.17860123518612
2143
+ - type: recall
2144
+ value: 93.03955933900852
2145
+ task:
2146
+ type: BitextMining
2147
+ - dataset:
2148
+ config: rus_Cyrl-hun_Latn
2149
+ name: MTEB NTREXBitextMining (rus_Cyrl-hun_Latn)
2150
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2151
+ split: test
2152
+ type: mteb/NTREX
2153
+ metrics:
2154
+ - type: accuracy
2155
+ value: 90.98647971957938
2156
+ - type: f1
2157
+ value: 88.43932565514937
2158
+ - type: main_score
2159
+ value: 88.43932565514937
2160
+ - type: precision
2161
+ value: 87.2475379736271
2162
+ - type: recall
2163
+ value: 90.98647971957938
2164
+ task:
2165
+ type: BitextMining
2166
+ - dataset:
2167
+ config: spa_Latn-hun_Latn
2168
+ name: MTEB NTREXBitextMining (spa_Latn-hun_Latn)
2169
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2170
+ split: test
2171
+ type: mteb/NTREX
2172
+ metrics:
2173
+ - type: accuracy
2174
+ value: 93.23985978968453
2175
+ - type: f1
2176
+ value: 91.3386746786847
2177
+ - type: main_score
2178
+ value: 91.3386746786847
2179
+ - type: precision
2180
+ value: 90.43148055416457
2181
+ - type: recall
2182
+ value: 93.23985978968453
2183
+ task:
2184
+ type: BitextMining
2185
+ - dataset:
2186
+ config: swa_Latn-hun_Latn
2187
+ name: MTEB NTREXBitextMining (swa_Latn-hun_Latn)
2188
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2189
+ split: test
2190
+ type: mteb/NTREX
2191
+ metrics:
2192
+ - type: accuracy
2193
+ value: 35.95393089634452
2194
+ - type: f1
2195
+ value: 30.612257939034187
2196
+ - type: main_score
2197
+ value: 30.612257939034187
2198
+ - type: precision
2199
+ value: 28.995078568906944
2200
+ - type: recall
2201
+ value: 35.95393089634452
2202
+ task:
2203
+ type: BitextMining
2204
+ - dataset:
2205
+ config: swe_Latn-hun_Latn
2206
+ name: MTEB NTREXBitextMining (swe_Latn-hun_Latn)
2207
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2208
+ split: test
2209
+ type: mteb/NTREX
2210
+ metrics:
2211
+ - type: accuracy
2212
+ value: 93.64046069103655
2213
+ - type: f1
2214
+ value: 91.86613253213153
2215
+ - type: main_score
2216
+ value: 91.86613253213153
2217
+ - type: precision
2218
+ value: 91.04072775830413
2219
+ - type: recall
2220
+ value: 93.64046069103655
2221
+ task:
2222
+ type: BitextMining
2223
+ - dataset:
2224
+ config: tam_Taml-hun_Latn
2225
+ name: MTEB NTREXBitextMining (tam_Taml-hun_Latn)
2226
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2227
+ split: test
2228
+ type: mteb/NTREX
2229
+ metrics:
2230
+ - type: accuracy
2231
+ value: 29.04356534802203
2232
+ - type: f1
2233
+ value: 25.164093122029808
2234
+ - type: main_score
2235
+ value: 25.164093122029808
2236
+ - type: precision
2237
+ value: 23.849573878565543
2238
+ - type: recall
2239
+ value: 29.04356534802203
2240
+ task:
2241
+ type: BitextMining
2242
+ - dataset:
2243
+ config: tur_Latn-hun_Latn
2244
+ name: MTEB NTREXBitextMining (tur_Latn-hun_Latn)
2245
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2246
+ split: test
2247
+ type: mteb/NTREX
2248
+ metrics:
2249
+ - type: accuracy
2250
+ value: 90.83625438157236
2251
+ - type: f1
2252
+ value: 88.36087464530128
2253
+ - type: main_score
2254
+ value: 88.36087464530128
2255
+ - type: precision
2256
+ value: 87.19829744616925
2257
+ - type: recall
2258
+ value: 90.83625438157236
2259
+ task:
2260
+ type: BitextMining
2261
+ - dataset:
2262
+ config: vie_Latn-hun_Latn
2263
+ name: MTEB NTREXBitextMining (vie_Latn-hun_Latn)
2264
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2265
+ split: test
2266
+ type: mteb/NTREX
2267
+ metrics:
2268
+ - type: accuracy
2269
+ value: 90.68602904356536
2270
+ - type: f1
2271
+ value: 88.10882991153397
2272
+ - type: main_score
2273
+ value: 88.10882991153397
2274
+ - type: precision
2275
+ value: 86.90118511099983
2276
+ - type: recall
2277
+ value: 90.68602904356536
2278
+ task:
2279
+ type: BitextMining
2280
+ - dataset:
2281
+ config: zho_Hant-hun_Latn
2282
+ name: MTEB NTREXBitextMining (zho_Hant-hun_Latn)
2283
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2284
+ split: test
2285
+ type: mteb/NTREX
2286
+ metrics:
2287
+ - type: accuracy
2288
+ value: 90.1352028042063
2289
+ - type: f1
2290
+ value: 87.46035720247039
2291
+ - type: main_score
2292
+ value: 87.46035720247039
2293
+ - type: precision
2294
+ value: 86.19810668383528
2295
+ - type: recall
2296
+ value: 90.1352028042063
2297
+ task:
2298
+ type: BitextMining
2299
+ - dataset:
2300
+ config: zul_Latn-hun_Latn
2301
+ name: MTEB NTREXBitextMining (zul_Latn-hun_Latn)
2302
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2303
+ split: test
2304
+ type: mteb/NTREX
2305
+ metrics:
2306
+ - type: accuracy
2307
+ value: 17.1256885327992
2308
+ - type: f1
2309
+ value: 13.692538409811572
2310
+ - type: main_score
2311
+ value: 13.692538409811572
2312
+ - type: precision
2313
+ value: 12.811084017018844
2314
+ - type: recall
2315
+ value: 17.1256885327992
2316
+ task:
2317
+ type: BitextMining
2318
+ - dataset:
2319
+ config: rom-hun
2320
+ name: MTEB RomaTalesBitextMining (rom-hun)
2321
+ revision: f4394dbca6845743cd33eba77431767b232ef489
2322
+ split: test
2323
+ type: kardosdrur/roma-tales
2324
+ metrics:
2325
+ - type: accuracy
2326
+ value: 6.046511627906977
2327
+ - type: f1
2328
+ value: 2.950830564784053
2329
+ - type: main_score
2330
+ value: 2.950830564784053
2331
+ - type: precision
2332
+ value: 2.295127353266888
2333
+ - type: recall
2334
+ value: 6.046511627906977
2335
+ task:
2336
+ type: BitextMining
2337
+ - dataset:
2338
+ config: hun_Latn
2339
+ name: MTEB SIB200Classification (hun_Latn)
2340
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2341
+ split: test
2342
+ type: mteb/sib200
2343
+ metrics:
2344
+ - type: accuracy
2345
+ value: 72.74509803921569
2346
+ - type: f1
2347
+ value: 71.6748881571977
2348
+ - type: f1_weighted
2349
+ value: 72.7699432186266
2350
+ - type: main_score
2351
+ value: 72.74509803921569
2352
+ task:
2353
+ type: Classification
2354
+ - dataset:
2355
+ config: hun_Latn
2356
+ name: MTEB SIB200Classification (hun_Latn)
2357
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2358
+ split: train
2359
+ type: mteb/sib200
2360
+ metrics:
2361
+ - type: accuracy
2362
+ value: 71.92582025677605
2363
+ - type: f1
2364
+ value: 70.9175403606058
2365
+ - type: f1_weighted
2366
+ value: 71.9988920000764
2367
+ - type: main_score
2368
+ value: 71.92582025677605
2369
+ task:
2370
+ type: Classification
2371
+ - dataset:
2372
+ config: hun_Latn
2373
+ name: MTEB SIB200Classification (hun_Latn)
2374
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2375
+ split: validation
2376
+ type: mteb/sib200
2377
+ metrics:
2378
+ - type: accuracy
2379
+ value: 66.76767676767676
2380
+ - type: f1
2381
+ value: 66.07599012119566
2382
+ - type: f1_weighted
2383
+ value: 67.15823510190054
2384
+ - type: main_score
2385
+ value: 66.76767676767676
2386
+ task:
2387
+ type: Classification
2388
+ - dataset:
2389
+ config: hun_Latn
2390
+ name: MTEB SIB200ClusteringS2S (hun_Latn)
2391
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2392
+ split: test
2393
+ type: mteb/sib200
2394
+ metrics:
2395
+ - type: main_score
2396
+ value: 39.24288169703154
2397
+ - type: v_measure
2398
+ value: 39.24288169703154
2399
+ - type: v_measure_std
2400
+ value: 2.214708184335194
2401
+ task:
2402
+ type: Clustering
2403
+ - dataset:
2404
+ config: hun-eng
2405
+ name: MTEB Tatoeba (hun-eng)
2406
+ revision: 69e8f12da6e31d59addadda9a9c8a2e601a0e282
2407
+ split: test
2408
+ type: mteb/tatoeba-bitext-mining
2409
+ metrics:
2410
+ - type: accuracy
2411
+ value: 91.0
2412
+ - type: f1
2413
+ value: 88.47999999999999
2414
+ - type: main_score
2415
+ value: 88.47999999999999
2416
+ - type: precision
2417
+ value: 87.3
2418
+ - type: recall
2419
+ value: 91.0
2420
+ task:
2421
+ type: BitextMining
2422
+ tags:
2423
+ - mteb
2424
+ ---
2425
+
2426
  ---
2427
  base_model: sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
2428
  language: