karsar commited on
Commit
37f3dc6
1 Parent(s): 6a1f3f4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2424 -0
README.md CHANGED
@@ -1,4 +1,2428 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  base_model: Alibaba-NLP/gte-multilingual-base
3
  language:
4
  - hu
 
1
  ---
2
+ model-index:
3
+ - name: karsar/gte-multilingual-base-hu
4
+ results:
5
+ - dataset:
6
+ config: hun_Latn-hun_Latn
7
+ name: MTEB BelebeleRetrieval (hun_Latn-hun_Latn)
8
+ revision: 75b399394a9803252cfec289d103de462763db7c
9
+ split: test
10
+ type: facebook/belebele
11
+ metrics:
12
+ - type: main_score
13
+ value: 84.52
14
+ - type: map_at_1
15
+ value: 75.333
16
+ - type: map_at_10
17
+ value: 81.589
18
+ - type: map_at_100
19
+ value: 81.857
20
+ - type: map_at_1000
21
+ value: 81.86099999999999
22
+ - type: map_at_20
23
+ value: 81.772
24
+ - type: map_at_3
25
+ value: 80.259
26
+ - type: map_at_5
27
+ value: 81.12
28
+ - type: mrr_at_1
29
+ value: 75.33333333333333
30
+ - type: mrr_at_10
31
+ value: 81.58880070546738
32
+ - type: mrr_at_100
33
+ value: 81.857421688991
34
+ - type: mrr_at_1000
35
+ value: 81.8609779154476
36
+ - type: mrr_at_20
37
+ value: 81.7720978955112
38
+ - type: mrr_at_3
39
+ value: 80.25925925925928
40
+ - type: mrr_at_5
41
+ value: 81.1203703703704
42
+ - type: nauc_map_at_1000_diff1
43
+ value: 83.1406785314172
44
+ - type: nauc_map_at_1000_max
45
+ value: 74.7920064826056
46
+ - type: nauc_map_at_1000_std
47
+ value: 9.75306995524627
48
+ - type: nauc_map_at_100_diff1
49
+ value: 83.13919284407014
50
+ - type: nauc_map_at_100_max
51
+ value: 74.79391249403568
52
+ - type: nauc_map_at_100_std
53
+ value: 9.755401974764572
54
+ - type: nauc_map_at_10_diff1
55
+ value: 83.08701108108275
56
+ - type: nauc_map_at_10_max
57
+ value: 74.88545349132366
58
+ - type: nauc_map_at_10_std
59
+ value: 9.997628643756531
60
+ - type: nauc_map_at_1_diff1
61
+ value: 84.86601118180064
62
+ - type: nauc_map_at_1_max
63
+ value: 72.13766122623628
64
+ - type: nauc_map_at_1_std
65
+ value: 5.8448184250495
66
+ - type: nauc_map_at_20_diff1
67
+ value: 83.08965421576404
68
+ - type: nauc_map_at_20_max
69
+ value: 74.814343891307
70
+ - type: nauc_map_at_20_std
71
+ value: 9.79543760958976
72
+ - type: nauc_map_at_3_diff1
73
+ value: 83.26947789593788
74
+ - type: nauc_map_at_3_max
75
+ value: 75.09180014138512
76
+ - type: nauc_map_at_3_std
77
+ value: 8.869243589731436
78
+ - type: nauc_map_at_5_diff1
79
+ value: 82.80692098415378
80
+ - type: nauc_map_at_5_max
81
+ value: 74.78410118423497
82
+ - type: nauc_map_at_5_std
83
+ value: 9.918556165939222
84
+ - type: nauc_mrr_at_1000_diff1
85
+ value: 83.1406785314172
86
+ - type: nauc_mrr_at_1000_max
87
+ value: 74.7920064826056
88
+ - type: nauc_mrr_at_1000_std
89
+ value: 9.75306995524627
90
+ - type: nauc_mrr_at_100_diff1
91
+ value: 83.13919284407014
92
+ - type: nauc_mrr_at_100_max
93
+ value: 74.79391249403568
94
+ - type: nauc_mrr_at_100_std
95
+ value: 9.755401974764572
96
+ - type: nauc_mrr_at_10_diff1
97
+ value: 83.08701108108275
98
+ - type: nauc_mrr_at_10_max
99
+ value: 74.88545349132366
100
+ - type: nauc_mrr_at_10_std
101
+ value: 9.997628643756531
102
+ - type: nauc_mrr_at_1_diff1
103
+ value: 84.86601118180064
104
+ - type: nauc_mrr_at_1_max
105
+ value: 72.13766122623628
106
+ - type: nauc_mrr_at_1_std
107
+ value: 5.8448184250495
108
+ - type: nauc_mrr_at_20_diff1
109
+ value: 83.08965421576404
110
+ - type: nauc_mrr_at_20_max
111
+ value: 74.814343891307
112
+ - type: nauc_mrr_at_20_std
113
+ value: 9.79543760958976
114
+ - type: nauc_mrr_at_3_diff1
115
+ value: 83.26947789593788
116
+ - type: nauc_mrr_at_3_max
117
+ value: 75.09180014138512
118
+ - type: nauc_mrr_at_3_std
119
+ value: 8.869243589731436
120
+ - type: nauc_mrr_at_5_diff1
121
+ value: 82.80692098415378
122
+ - type: nauc_mrr_at_5_max
123
+ value: 74.78410118423497
124
+ - type: nauc_mrr_at_5_std
125
+ value: 9.918556165939222
126
+ - type: nauc_ndcg_at_1000_diff1
127
+ value: 82.87191315538433
128
+ - type: nauc_ndcg_at_1000_max
129
+ value: 75.16982102922016
130
+ - type: nauc_ndcg_at_1000_std
131
+ value: 10.52683594414672
132
+ - type: nauc_ndcg_at_100_diff1
133
+ value: 82.85309969623432
134
+ - type: nauc_ndcg_at_100_max
135
+ value: 75.23344364153238
136
+ - type: nauc_ndcg_at_100_std
137
+ value: 10.607493012936814
138
+ - type: nauc_ndcg_at_10_diff1
139
+ value: 82.4777695687479
140
+ - type: nauc_ndcg_at_10_max
141
+ value: 75.7487283699043
142
+ - type: nauc_ndcg_at_10_std
143
+ value: 12.106303697974104
144
+ - type: nauc_ndcg_at_1_diff1
145
+ value: 84.86601118180064
146
+ - type: nauc_ndcg_at_1_max
147
+ value: 72.13766122623628
148
+ - type: nauc_ndcg_at_1_std
149
+ value: 5.8448184250495
150
+ - type: nauc_ndcg_at_20_diff1
151
+ value: 82.4859742044606
152
+ - type: nauc_ndcg_at_20_max
153
+ value: 75.47876530790867
154
+ - type: nauc_ndcg_at_20_std
155
+ value: 11.182962707766247
156
+ - type: nauc_ndcg_at_3_diff1
157
+ value: 82.7287522547649
158
+ - type: nauc_ndcg_at_3_max
159
+ value: 76.05573841110964
160
+ - type: nauc_ndcg_at_3_std
161
+ value: 9.697064965813148
162
+ - type: nauc_ndcg_at_5_diff1
163
+ value: 81.75303729599945
164
+ - type: nauc_ndcg_at_5_max
165
+ value: 75.49363885293647
166
+ - type: nauc_ndcg_at_5_std
167
+ value: 11.862780018840077
168
+ - type: nauc_precision_at_1000_diff1
169
+ value: .nan
170
+ - type: nauc_precision_at_1000_max
171
+ value: .nan
172
+ - type: nauc_precision_at_1000_std
173
+ value: .nan
174
+ - type: nauc_precision_at_100_diff1
175
+ value: 81.02240896358386
176
+ - type: nauc_precision_at_100_max
177
+ value: 84.94397759103616
178
+ - type: nauc_precision_at_100_std
179
+ value: 23.023653906007944
180
+ - type: nauc_precision_at_10_diff1
181
+ value: 78.26428817140886
182
+ - type: nauc_precision_at_10_max
183
+ value: 81.97044899831255
184
+ - type: nauc_precision_at_10_std
185
+ value: 28.695922813569396
186
+ - type: nauc_precision_at_1_diff1
187
+ value: 84.86601118180064
188
+ - type: nauc_precision_at_1_max
189
+ value: 72.13766122623628
190
+ - type: nauc_precision_at_1_std
191
+ value: 5.8448184250495
192
+ - type: nauc_precision_at_20_diff1
193
+ value: 75.53546671193718
194
+ - type: nauc_precision_at_20_max
195
+ value: 82.53543841779138
196
+ - type: nauc_precision_at_20_std
197
+ value: 26.165011459129044
198
+ - type: nauc_precision_at_3_diff1
199
+ value: 80.63337345511478
200
+ - type: nauc_precision_at_3_max
201
+ value: 79.77311525965087
202
+ - type: nauc_precision_at_3_std
203
+ value: 12.808288688017747
204
+ - type: nauc_precision_at_5_diff1
205
+ value: 76.24293162958055
206
+ - type: nauc_precision_at_5_max
207
+ value: 78.78492220858374
208
+ - type: nauc_precision_at_5_std
209
+ value: 21.992467398944566
210
+ - type: nauc_recall_at_1000_diff1
211
+ value: .nan
212
+ - type: nauc_recall_at_1000_max
213
+ value: .nan
214
+ - type: nauc_recall_at_1000_std
215
+ value: .nan
216
+ - type: nauc_recall_at_100_diff1
217
+ value: 81.02240896358384
218
+ - type: nauc_recall_at_100_max
219
+ value: 84.94397759103697
220
+ - type: nauc_recall_at_100_std
221
+ value: 23.02365390600609
222
+ - type: nauc_recall_at_10_diff1
223
+ value: 78.26428817140881
224
+ - type: nauc_recall_at_10_max
225
+ value: 81.97044899831292
226
+ - type: nauc_recall_at_10_std
227
+ value: 28.69592281356998
228
+ - type: nauc_recall_at_1_diff1
229
+ value: 84.86601118180064
230
+ - type: nauc_recall_at_1_max
231
+ value: 72.13766122623628
232
+ - type: nauc_recall_at_1_std
233
+ value: 5.8448184250495
234
+ - type: nauc_recall_at_20_diff1
235
+ value: 75.53546671193709
236
+ - type: nauc_recall_at_20_max
237
+ value: 82.53543841779138
238
+ - type: nauc_recall_at_20_std
239
+ value: 26.165011459128955
240
+ - type: nauc_recall_at_3_diff1
241
+ value: 80.63337345511479
242
+ - type: nauc_recall_at_3_max
243
+ value: 79.77311525965078
244
+ - type: nauc_recall_at_3_std
245
+ value: 12.808288688017635
246
+ - type: nauc_recall_at_5_diff1
247
+ value: 76.24293162958065
248
+ - type: nauc_recall_at_5_max
249
+ value: 78.78492220858384
250
+ - type: nauc_recall_at_5_std
251
+ value: 21.9924673989446
252
+ - type: ndcg_at_1
253
+ value: 75.333
254
+ - type: ndcg_at_10
255
+ value: 84.52
256
+ - type: ndcg_at_100
257
+ value: 85.765
258
+ - type: ndcg_at_1000
259
+ value: 85.85199999999999
260
+ - type: ndcg_at_20
261
+ value: 85.19200000000001
262
+ - type: ndcg_at_3
263
+ value: 81.82300000000001
264
+ - type: ndcg_at_5
265
+ value: 83.377
266
+ - type: precision_at_1
267
+ value: 75.333
268
+ - type: precision_at_10
269
+ value: 9.367
270
+ - type: precision_at_100
271
+ value: 0.993
272
+ - type: precision_at_1000
273
+ value: 0.1
274
+ - type: precision_at_20
275
+ value: 4.817
276
+ - type: precision_at_3
277
+ value: 28.778
278
+ - type: precision_at_5
279
+ value: 18.022
280
+ - type: recall_at_1
281
+ value: 75.333
282
+ - type: recall_at_10
283
+ value: 93.667
284
+ - type: recall_at_100
285
+ value: 99.333
286
+ - type: recall_at_1000
287
+ value: 100.0
288
+ - type: recall_at_20
289
+ value: 96.333
290
+ - type: recall_at_3
291
+ value: 86.333
292
+ - type: recall_at_5
293
+ value: 90.11099999999999
294
+ task:
295
+ type: Retrieval
296
+ - dataset:
297
+ config: hun_Latn-eng_Latn
298
+ name: MTEB BelebeleRetrieval (hun_Latn-eng_Latn)
299
+ revision: 75b399394a9803252cfec289d103de462763db7c
300
+ split: test
301
+ type: facebook/belebele
302
+ metrics:
303
+ - type: main_score
304
+ value: 83.101
305
+ - type: map_at_1
306
+ value: 73.556
307
+ - type: map_at_10
308
+ value: 80.011
309
+ - type: map_at_100
310
+ value: 80.284
311
+ - type: map_at_1000
312
+ value: 80.28999999999999
313
+ - type: map_at_20
314
+ value: 80.167
315
+ - type: map_at_3
316
+ value: 78.556
317
+ - type: map_at_5
318
+ value: 79.45
319
+ - type: mrr_at_1
320
+ value: 73.55555555555556
321
+ - type: mrr_at_10
322
+ value: 80.01075837742505
323
+ - type: mrr_at_100
324
+ value: 80.28385145874786
325
+ - type: mrr_at_1000
326
+ value: 80.29037744428379
327
+ - type: mrr_at_20
328
+ value: 80.16723881362682
329
+ - type: mrr_at_3
330
+ value: 78.55555555555557
331
+ - type: mrr_at_5
332
+ value: 79.45000000000005
333
+ - type: nauc_map_at_1000_diff1
334
+ value: 82.98075224524453
335
+ - type: nauc_map_at_1000_max
336
+ value: 70.44697913937723
337
+ - type: nauc_map_at_1000_std
338
+ value: 2.870876330916836
339
+ - type: nauc_map_at_100_diff1
340
+ value: 82.98154927855126
341
+ - type: nauc_map_at_100_max
342
+ value: 70.45314001730156
343
+ - type: nauc_map_at_100_std
344
+ value: 2.8835564687908257
345
+ - type: nauc_map_at_10_diff1
346
+ value: 82.84678746705569
347
+ - type: nauc_map_at_10_max
348
+ value: 70.60564910219685
349
+ - type: nauc_map_at_10_std
350
+ value: 3.2173817428023015
351
+ - type: nauc_map_at_1_diff1
352
+ value: 84.96087414405248
353
+ - type: nauc_map_at_1_max
354
+ value: 67.37556822473925
355
+ - type: nauc_map_at_1_std
356
+ value: -0.18018778633416485
357
+ - type: nauc_map_at_20_diff1
358
+ value: 82.99903430984571
359
+ - type: nauc_map_at_20_max
360
+ value: 70.5101842247085
361
+ - type: nauc_map_at_20_std
362
+ value: 2.8656500581185083
363
+ - type: nauc_map_at_3_diff1
364
+ value: 82.73317866665256
365
+ - type: nauc_map_at_3_max
366
+ value: 70.82189092891453
367
+ - type: nauc_map_at_3_std
368
+ value: 2.877404014763454
369
+ - type: nauc_map_at_5_diff1
370
+ value: 82.62883699148186
371
+ - type: nauc_map_at_5_max
372
+ value: 70.43732522032901
373
+ - type: nauc_map_at_5_std
374
+ value: 2.33684448635595
375
+ - type: nauc_mrr_at_1000_diff1
376
+ value: 82.98075224524453
377
+ - type: nauc_mrr_at_1000_max
378
+ value: 70.44697913937723
379
+ - type: nauc_mrr_at_1000_std
380
+ value: 2.870876330916836
381
+ - type: nauc_mrr_at_100_diff1
382
+ value: 82.98154927855126
383
+ - type: nauc_mrr_at_100_max
384
+ value: 70.45314001730156
385
+ - type: nauc_mrr_at_100_std
386
+ value: 2.8835564687908257
387
+ - type: nauc_mrr_at_10_diff1
388
+ value: 82.84678746705569
389
+ - type: nauc_mrr_at_10_max
390
+ value: 70.60564910219685
391
+ - type: nauc_mrr_at_10_std
392
+ value: 3.2173817428023015
393
+ - type: nauc_mrr_at_1_diff1
394
+ value: 84.96087414405248
395
+ - type: nauc_mrr_at_1_max
396
+ value: 67.37556822473925
397
+ - type: nauc_mrr_at_1_std
398
+ value: -0.18018778633416485
399
+ - type: nauc_mrr_at_20_diff1
400
+ value: 82.99903430984571
401
+ - type: nauc_mrr_at_20_max
402
+ value: 70.5101842247085
403
+ - type: nauc_mrr_at_20_std
404
+ value: 2.8656500581185083
405
+ - type: nauc_mrr_at_3_diff1
406
+ value: 82.73317866665256
407
+ - type: nauc_mrr_at_3_max
408
+ value: 70.82189092891453
409
+ - type: nauc_mrr_at_3_std
410
+ value: 2.877404014763454
411
+ - type: nauc_mrr_at_5_diff1
412
+ value: 82.62883699148186
413
+ - type: nauc_mrr_at_5_max
414
+ value: 70.43732522032901
415
+ - type: nauc_mrr_at_5_std
416
+ value: 2.33684448635595
417
+ - type: nauc_ndcg_at_1000_diff1
418
+ value: 82.79629619444499
419
+ - type: nauc_ndcg_at_1000_max
420
+ value: 71.0076319722781
421
+ - type: nauc_ndcg_at_1000_std
422
+ value: 3.7381182242930464
423
+ - type: nauc_ndcg_at_100_diff1
424
+ value: 82.83397899949976
425
+ - type: nauc_ndcg_at_100_max
426
+ value: 71.18500075519282
427
+ - type: nauc_ndcg_at_100_std
428
+ value: 4.132633921815649
429
+ - type: nauc_ndcg_at_10_diff1
430
+ value: 82.27523217182016
431
+ - type: nauc_ndcg_at_10_max
432
+ value: 72.0518800681147
433
+ - type: nauc_ndcg_at_10_std
434
+ value: 5.790750391790079
435
+ - type: nauc_ndcg_at_1_diff1
436
+ value: 84.96087414405248
437
+ - type: nauc_ndcg_at_1_max
438
+ value: 67.37556822473925
439
+ - type: nauc_ndcg_at_1_std
440
+ value: -0.18018778633416485
441
+ - type: nauc_ndcg_at_20_diff1
442
+ value: 82.97351669681734
443
+ - type: nauc_ndcg_at_20_max
444
+ value: 71.696223879848
445
+ - type: nauc_ndcg_at_20_std
446
+ value: 4.317621313606248
447
+ - type: nauc_ndcg_at_3_diff1
448
+ value: 81.94856814665425
449
+ - type: nauc_ndcg_at_3_max
450
+ value: 72.12618276320369
451
+ - type: nauc_ndcg_at_3_std
452
+ value: 4.24079481069279
453
+ - type: nauc_ndcg_at_5_diff1
454
+ value: 81.70729227032065
455
+ - type: nauc_ndcg_at_5_max
456
+ value: 71.49462564098667
457
+ - type: nauc_ndcg_at_5_std
458
+ value: 3.2972695951356026
459
+ - type: nauc_precision_at_1000_diff1
460
+ value: .nan
461
+ - type: nauc_precision_at_1000_max
462
+ value: .nan
463
+ - type: nauc_precision_at_1000_std
464
+ value: .nan
465
+ - type: nauc_precision_at_100_diff1
466
+ value: 87.0577860773934
467
+ - type: nauc_precision_at_100_max
468
+ value: 89.96265172735775
469
+ - type: nauc_precision_at_100_std
470
+ value: 46.50378669986745
471
+ - type: nauc_precision_at_10_diff1
472
+ value: 78.78833584715922
473
+ - type: nauc_precision_at_10_max
474
+ value: 82.80399339222852
475
+ - type: nauc_precision_at_10_std
476
+ value: 26.482798247504043
477
+ - type: nauc_precision_at_1_diff1
478
+ value: 84.96087414405248
479
+ - type: nauc_precision_at_1_max
480
+ value: 67.37556822473925
481
+ - type: nauc_precision_at_1_std
482
+ value: -0.18018778633416485
483
+ - type: nauc_precision_at_20_diff1
484
+ value: 85.8989050165519
485
+ - type: nauc_precision_at_20_max
486
+ value: 83.69302266361063
487
+ - type: nauc_precision_at_20_std
488
+ value: 18.366437484084422
489
+ - type: nauc_precision_at_3_diff1
490
+ value: 78.9832574887652
491
+ - type: nauc_precision_at_3_max
492
+ value: 77.09635804306849
493
+ - type: nauc_precision_at_3_std
494
+ value: 9.522746282198423
495
+ - type: nauc_precision_at_5_diff1
496
+ value: 77.29170153028011
497
+ - type: nauc_precision_at_5_max
498
+ value: 76.44009966344971
499
+ - type: nauc_precision_at_5_std
500
+ value: 7.807590041092263
501
+ - type: nauc_recall_at_1000_diff1
502
+ value: .nan
503
+ - type: nauc_recall_at_1000_max
504
+ value: .nan
505
+ - type: nauc_recall_at_1000_std
506
+ value: .nan
507
+ - type: nauc_recall_at_100_diff1
508
+ value: 87.05778607739357
509
+ - type: nauc_recall_at_100_max
510
+ value: 89.96265172735798
511
+ - type: nauc_recall_at_100_std
512
+ value: 46.50378669986473
513
+ - type: nauc_recall_at_10_diff1
514
+ value: 78.78833584715929
515
+ - type: nauc_recall_at_10_max
516
+ value: 82.80399339222863
517
+ - type: nauc_recall_at_10_std
518
+ value: 26.482798247504114
519
+ - type: nauc_recall_at_1_diff1
520
+ value: 84.96087414405248
521
+ - type: nauc_recall_at_1_max
522
+ value: 67.37556822473925
523
+ - type: nauc_recall_at_1_std
524
+ value: -0.18018778633416485
525
+ - type: nauc_recall_at_20_diff1
526
+ value: 85.89890501655198
527
+ - type: nauc_recall_at_20_max
528
+ value: 83.69302266361105
529
+ - type: nauc_recall_at_20_std
530
+ value: 18.366437484084596
531
+ - type: nauc_recall_at_3_diff1
532
+ value: 78.98325748876506
533
+ - type: nauc_recall_at_3_max
534
+ value: 77.09635804306843
535
+ - type: nauc_recall_at_3_std
536
+ value: 9.522746282198543
537
+ - type: nauc_recall_at_5_diff1
538
+ value: 77.29170153028014
539
+ - type: nauc_recall_at_5_max
540
+ value: 76.44009966345003
541
+ - type: nauc_recall_at_5_std
542
+ value: 7.807590041092628
543
+ - type: ndcg_at_1
544
+ value: 73.556
545
+ - type: ndcg_at_10
546
+ value: 83.101
547
+ - type: ndcg_at_100
548
+ value: 84.44
549
+ - type: ndcg_at_1000
550
+ value: 84.576
551
+ - type: ndcg_at_20
552
+ value: 83.685
553
+ - type: ndcg_at_3
554
+ value: 80.12899999999999
555
+ - type: ndcg_at_5
556
+ value: 81.76
557
+ - type: precision_at_1
558
+ value: 73.556
559
+ - type: precision_at_10
560
+ value: 9.278
561
+ - type: precision_at_100
562
+ value: 0.9900000000000001
563
+ - type: precision_at_1000
564
+ value: 0.1
565
+ - type: precision_at_20
566
+ value: 4.756
567
+ - type: precision_at_3
568
+ value: 28.222
569
+ - type: precision_at_5
570
+ value: 17.732999999999997
571
+ - type: recall_at_1
572
+ value: 73.556
573
+ - type: recall_at_10
574
+ value: 92.778
575
+ - type: recall_at_100
576
+ value: 99.0
577
+ - type: recall_at_1000
578
+ value: 100.0
579
+ - type: recall_at_20
580
+ value: 95.111
581
+ - type: recall_at_3
582
+ value: 84.667
583
+ - type: recall_at_5
584
+ value: 88.667
585
+ task:
586
+ type: Retrieval
587
+ - dataset:
588
+ config: eng_Latn-hun_Latn
589
+ name: MTEB BelebeleRetrieval (eng_Latn-hun_Latn)
590
+ revision: 75b399394a9803252cfec289d103de462763db7c
591
+ split: test
592
+ type: facebook/belebele
593
+ metrics:
594
+ - type: main_score
595
+ value: 79.566
596
+ - type: map_at_1
597
+ value: 68.77799999999999
598
+ - type: map_at_10
599
+ value: 76.066
600
+ - type: map_at_100
601
+ value: 76.458
602
+ - type: map_at_1000
603
+ value: 76.461
604
+ - type: map_at_20
605
+ value: 76.31700000000001
606
+ - type: map_at_3
607
+ value: 74.574
608
+ - type: map_at_5
609
+ value: 75.313
610
+ - type: mrr_at_1
611
+ value: 68.77777777777779
612
+ - type: mrr_at_10
613
+ value: 76.06582892416228
614
+ - type: mrr_at_100
615
+ value: 76.4576917776982
616
+ - type: mrr_at_1000
617
+ value: 76.4606772011712
618
+ - type: mrr_at_20
619
+ value: 76.31707897652173
620
+ - type: mrr_at_3
621
+ value: 74.57407407407408
622
+ - type: mrr_at_5
623
+ value: 75.31296296296298
624
+ - type: nauc_map_at_1000_diff1
625
+ value: 78.84953659186075
626
+ - type: nauc_map_at_1000_max
627
+ value: 72.95319354945482
628
+ - type: nauc_map_at_1000_std
629
+ value: 10.486309697258944
630
+ - type: nauc_map_at_100_diff1
631
+ value: 78.85001032587249
632
+ - type: nauc_map_at_100_max
633
+ value: 72.95426928056654
634
+ - type: nauc_map_at_100_std
635
+ value: 10.483813797190445
636
+ - type: nauc_map_at_10_diff1
637
+ value: 78.70526630685885
638
+ - type: nauc_map_at_10_max
639
+ value: 73.08594298926852
640
+ - type: nauc_map_at_10_std
641
+ value: 10.738816033415464
642
+ - type: nauc_map_at_1_diff1
643
+ value: 81.09615388366655
644
+ - type: nauc_map_at_1_max
645
+ value: 71.1979198161698
646
+ - type: nauc_map_at_1_std
647
+ value: 8.331854082828887
648
+ - type: nauc_map_at_20_diff1
649
+ value: 78.79122644457274
650
+ - type: nauc_map_at_20_max
651
+ value: 73.01380930608467
652
+ - type: nauc_map_at_20_std
653
+ value: 10.704116143456673
654
+ - type: nauc_map_at_3_diff1
655
+ value: 78.74281223888761
656
+ - type: nauc_map_at_3_max
657
+ value: 72.63559145253599
658
+ - type: nauc_map_at_3_std
659
+ value: 8.949203596261594
660
+ - type: nauc_map_at_5_diff1
661
+ value: 78.65419312305616
662
+ - type: nauc_map_at_5_max
663
+ value: 72.9058122628293
664
+ - type: nauc_map_at_5_std
665
+ value: 9.7937096286835
666
+ - type: nauc_mrr_at_1000_diff1
667
+ value: 78.84953659186075
668
+ - type: nauc_mrr_at_1000_max
669
+ value: 72.95319354945482
670
+ - type: nauc_mrr_at_1000_std
671
+ value: 10.486309697258944
672
+ - type: nauc_mrr_at_100_diff1
673
+ value: 78.85001032587249
674
+ - type: nauc_mrr_at_100_max
675
+ value: 72.95426928056654
676
+ - type: nauc_mrr_at_100_std
677
+ value: 10.483813797190445
678
+ - type: nauc_mrr_at_10_diff1
679
+ value: 78.70526630685885
680
+ - type: nauc_mrr_at_10_max
681
+ value: 73.08594298926852
682
+ - type: nauc_mrr_at_10_std
683
+ value: 10.738816033415464
684
+ - type: nauc_mrr_at_1_diff1
685
+ value: 81.09615388366655
686
+ - type: nauc_mrr_at_1_max
687
+ value: 71.1979198161698
688
+ - type: nauc_mrr_at_1_std
689
+ value: 8.331854082828887
690
+ - type: nauc_mrr_at_20_diff1
691
+ value: 78.79122644457274
692
+ - type: nauc_mrr_at_20_max
693
+ value: 73.01380930608467
694
+ - type: nauc_mrr_at_20_std
695
+ value: 10.704116143456673
696
+ - type: nauc_mrr_at_3_diff1
697
+ value: 78.74281223888761
698
+ - type: nauc_mrr_at_3_max
699
+ value: 72.63559145253599
700
+ - type: nauc_mrr_at_3_std
701
+ value: 8.949203596261594
702
+ - type: nauc_mrr_at_5_diff1
703
+ value: 78.65419312305616
704
+ - type: nauc_mrr_at_5_max
705
+ value: 72.9058122628293
706
+ - type: nauc_mrr_at_5_std
707
+ value: 9.7937096286835
708
+ - type: nauc_ndcg_at_1000_diff1
709
+ value: 78.52448995680614
710
+ - type: nauc_ndcg_at_1000_max
711
+ value: 73.37903474635324
712
+ - type: nauc_ndcg_at_1000_std
713
+ value: 11.392330178257408
714
+ - type: nauc_ndcg_at_100_diff1
715
+ value: 78.53878497635209
716
+ - type: nauc_ndcg_at_100_max
717
+ value: 73.42928694892305
718
+ - type: nauc_ndcg_at_100_std
719
+ value: 11.423236407965893
720
+ - type: nauc_ndcg_at_10_diff1
721
+ value: 77.78729543542663
722
+ - type: nauc_ndcg_at_10_max
723
+ value: 74.27536294287631
724
+ - type: nauc_ndcg_at_10_std
725
+ value: 13.367470230818531
726
+ - type: nauc_ndcg_at_1_diff1
727
+ value: 81.09615388366655
728
+ - type: nauc_ndcg_at_1_max
729
+ value: 71.1979198161698
730
+ - type: nauc_ndcg_at_1_std
731
+ value: 8.331854082828887
732
+ - type: nauc_ndcg_at_20_diff1
733
+ value: 78.11371876111158
734
+ - type: nauc_ndcg_at_20_max
735
+ value: 74.02257268275582
736
+ - type: nauc_ndcg_at_20_std
737
+ value: 13.38983541565397
738
+ - type: nauc_ndcg_at_3_diff1
739
+ value: 77.90927387771217
740
+ - type: nauc_ndcg_at_3_max
741
+ value: 73.13407026390954
742
+ - type: nauc_ndcg_at_3_std
743
+ value: 9.168566635087503
744
+ - type: nauc_ndcg_at_5_diff1
745
+ value: 77.67838156766508
746
+ - type: nauc_ndcg_at_5_max
747
+ value: 73.69372140026746
748
+ - type: nauc_ndcg_at_5_std
749
+ value: 10.869564941918753
750
+ - type: nauc_precision_at_1000_diff1
751
+ value: .nan
752
+ - type: nauc_precision_at_1000_max
753
+ value: .nan
754
+ - type: nauc_precision_at_1000_std
755
+ value: .nan
756
+ - type: nauc_precision_at_100_diff1
757
+ value: 81.13134142545822
758
+ - type: nauc_precision_at_100_max
759
+ value: 83.58232181761284
760
+ - type: nauc_precision_at_100_std
761
+ value: 21.934329287273574
762
+ - type: nauc_precision_at_10_diff1
763
+ value: 72.03877629483148
764
+ - type: nauc_precision_at_10_max
765
+ value: 82.56879222277134
766
+ - type: nauc_precision_at_10_std
767
+ value: 32.573735376503436
768
+ - type: nauc_precision_at_1_diff1
769
+ value: 81.09615388366655
770
+ - type: nauc_precision_at_1_max
771
+ value: 71.1979198161698
772
+ - type: nauc_precision_at_1_std
773
+ value: 8.331854082828887
774
+ - type: nauc_precision_at_20_diff1
775
+ value: 72.38870390923626
776
+ - type: nauc_precision_at_20_max
777
+ value: 84.61321635572419
778
+ - type: nauc_precision_at_20_std
779
+ value: 44.62061554181373
780
+ - type: nauc_precision_at_3_diff1
781
+ value: 74.8060913337046
782
+ - type: nauc_precision_at_3_max
783
+ value: 74.98517702862958
784
+ - type: nauc_precision_at_3_std
785
+ value: 9.985540040173424
786
+ - type: nauc_precision_at_5_diff1
787
+ value: 73.36844940809873
788
+ - type: nauc_precision_at_5_max
789
+ value: 77.25002548160217
790
+ - type: nauc_precision_at_5_std
791
+ value: 15.98642922666964
792
+ - type: nauc_recall_at_1000_diff1
793
+ value: .nan
794
+ - type: nauc_recall_at_1000_max
795
+ value: .nan
796
+ - type: nauc_recall_at_1000_std
797
+ value: .nan
798
+ - type: nauc_recall_at_100_diff1
799
+ value: 81.13134142545819
800
+ - type: nauc_recall_at_100_max
801
+ value: 83.58232181761542
802
+ - type: nauc_recall_at_100_std
803
+ value: 21.934329287270415
804
+ - type: nauc_recall_at_10_diff1
805
+ value: 72.03877629483173
806
+ - type: nauc_recall_at_10_max
807
+ value: 82.56879222277149
808
+ - type: nauc_recall_at_10_std
809
+ value: 32.57373537650351
810
+ - type: nauc_recall_at_1_diff1
811
+ value: 81.09615388366655
812
+ - type: nauc_recall_at_1_max
813
+ value: 71.1979198161698
814
+ - type: nauc_recall_at_1_std
815
+ value: 8.331854082828887
816
+ - type: nauc_recall_at_20_diff1
817
+ value: 72.3887039092368
818
+ - type: nauc_recall_at_20_max
819
+ value: 84.61321635572472
820
+ - type: nauc_recall_at_20_std
821
+ value: 44.62061554181426
822
+ - type: nauc_recall_at_3_diff1
823
+ value: 74.80609133370437
824
+ - type: nauc_recall_at_3_max
825
+ value: 74.98517702862947
826
+ - type: nauc_recall_at_3_std
827
+ value: 9.985540040173234
828
+ - type: nauc_recall_at_5_diff1
829
+ value: 73.36844940809881
830
+ - type: nauc_recall_at_5_max
831
+ value: 77.2500254816023
832
+ - type: nauc_recall_at_5_std
833
+ value: 15.986429226669795
834
+ - type: ndcg_at_1
835
+ value: 68.77799999999999
836
+ - type: ndcg_at_10
837
+ value: 79.566
838
+ - type: ndcg_at_100
839
+ value: 81.453
840
+ - type: ndcg_at_1000
841
+ value: 81.538
842
+ - type: ndcg_at_20
843
+ value: 80.47
844
+ - type: ndcg_at_3
845
+ value: 76.427
846
+ - type: ndcg_at_5
847
+ value: 77.78
848
+ - type: precision_at_1
849
+ value: 68.77799999999999
850
+ - type: precision_at_10
851
+ value: 9.056000000000001
852
+ - type: precision_at_100
853
+ value: 0.993
854
+ - type: precision_at_1000
855
+ value: 0.1
856
+ - type: precision_at_20
857
+ value: 4.7059999999999995
858
+ - type: precision_at_3
859
+ value: 27.259
860
+ - type: precision_at_5
861
+ value: 17.022000000000002
862
+ - type: recall_at_1
863
+ value: 68.77799999999999
864
+ - type: recall_at_10
865
+ value: 90.556
866
+ - type: recall_at_100
867
+ value: 99.333
868
+ - type: recall_at_1000
869
+ value: 100.0
870
+ - type: recall_at_20
871
+ value: 94.111
872
+ - type: recall_at_3
873
+ value: 81.77799999999999
874
+ - type: recall_at_5
875
+ value: 85.111
876
+ task:
877
+ type: Retrieval
878
+ - dataset:
879
+ config: eng_Latn-hun_Latn
880
+ name: MTEB BibleNLPBitextMining (eng_Latn-hun_Latn)
881
+ revision: 264a18480c529d9e922483839b4b9758e690b762
882
+ split: train
883
+ type: davidstap/biblenlp-corpus-mmteb
884
+ metrics:
885
+ - type: accuracy
886
+ value: 76.953125
887
+ - type: f1
888
+ value: 71.86197916666667
889
+ - type: main_score
890
+ value: 71.86197916666667
891
+ - type: precision
892
+ value: 69.81770833333334
893
+ - type: recall
894
+ value: 76.953125
895
+ task:
896
+ type: BitextMining
897
+ - dataset:
898
+ config: hun_Latn-eng_Latn
899
+ name: MTEB BibleNLPBitextMining (hun_Latn-eng_Latn)
900
+ revision: 264a18480c529d9e922483839b4b9758e690b762
901
+ split: train
902
+ type: davidstap/biblenlp-corpus-mmteb
903
+ metrics:
904
+ - type: accuracy
905
+ value: 85.15625
906
+ - type: f1
907
+ value: 81.11979166666667
908
+ - type: main_score
909
+ value: 81.11979166666667
910
+ - type: precision
911
+ value: 79.23177083333334
912
+ - type: recall
913
+ value: 85.15625
914
+ task:
915
+ type: BitextMining
916
+ - dataset:
917
+ config: default
918
+ name: MTEB HunSum2AbstractiveRetrieval (default)
919
+ revision: 24e1445c8180d937f0a16f8ae8a62e77cc952e56
920
+ split: test
921
+ type: SZTAKI-HLT/HunSum-2-abstractive
922
+ metrics:
923
+ - type: main_score
924
+ value: 80.28
925
+ - type: map_at_1
926
+ value: 80.28
927
+ - type: map_at_10
928
+ value: 84.904
929
+ - type: map_at_100
930
+ value: 85.146
931
+ - type: map_at_1000
932
+ value: 85.151
933
+ - type: map_at_20
934
+ value: 85.06
935
+ - type: map_at_3
936
+ value: 83.94200000000001
937
+ - type: map_at_5
938
+ value: 84.568
939
+ - type: mrr_at_1
940
+ value: 80.28028028028028
941
+ - type: mrr_at_10
942
+ value: 84.90418990418983
943
+ - type: mrr_at_100
944
+ value: 85.14630746415321
945
+ - type: mrr_at_1000
946
+ value: 85.15092295233896
947
+ - type: mrr_at_20
948
+ value: 85.0602092982553
949
+ - type: mrr_at_3
950
+ value: 83.94227560894221
951
+ - type: mrr_at_5
952
+ value: 84.56790123456784
953
+ - type: nauc_map_at_1000_diff1
954
+ value: 88.79097723803582
955
+ - type: nauc_map_at_1000_max
956
+ value: 73.98309940197979
957
+ - type: nauc_map_at_1000_std
958
+ value: 8.542178772436394
959
+ - type: nauc_map_at_100_diff1
960
+ value: 88.78960257384884
961
+ - type: nauc_map_at_100_max
962
+ value: 73.98791845872987
963
+ - type: nauc_map_at_100_std
964
+ value: 8.548067869435512
965
+ - type: nauc_map_at_10_diff1
966
+ value: 88.69014462571421
967
+ - type: nauc_map_at_10_max
968
+ value: 74.14057877906977
969
+ - type: nauc_map_at_10_std
970
+ value: 8.859912246907557
971
+ - type: nauc_map_at_1_diff1
972
+ value: 89.97737048914607
973
+ - type: nauc_map_at_1_max
974
+ value: 71.45737401142345
975
+ - type: nauc_map_at_1_std
976
+ value: 4.759040523357649
977
+ - type: nauc_map_at_20_diff1
978
+ value: 88.77444892974766
979
+ - type: nauc_map_at_20_max
980
+ value: 74.02582129341143
981
+ - type: nauc_map_at_20_std
982
+ value: 8.540371486769867
983
+ - type: nauc_map_at_3_diff1
984
+ value: 88.63122911038182
985
+ - type: nauc_map_at_3_max
986
+ value: 74.00939999585503
987
+ - type: nauc_map_at_3_std
988
+ value: 8.800123446309959
989
+ - type: nauc_map_at_5_diff1
990
+ value: 88.60660773314059
991
+ - type: nauc_map_at_5_max
992
+ value: 74.22116501727933
993
+ - type: nauc_map_at_5_std
994
+ value: 9.32259867764275
995
+ - type: nauc_mrr_at_1000_diff1
996
+ value: 88.79097723803582
997
+ - type: nauc_mrr_at_1000_max
998
+ value: 73.98309940197979
999
+ - type: nauc_mrr_at_1000_std
1000
+ value: 8.542178772436394
1001
+ - type: nauc_mrr_at_100_diff1
1002
+ value: 88.78960257384884
1003
+ - type: nauc_mrr_at_100_max
1004
+ value: 73.98791845872987
1005
+ - type: nauc_mrr_at_100_std
1006
+ value: 8.548067869435512
1007
+ - type: nauc_mrr_at_10_diff1
1008
+ value: 88.69014462571421
1009
+ - type: nauc_mrr_at_10_max
1010
+ value: 74.14057877906977
1011
+ - type: nauc_mrr_at_10_std
1012
+ value: 8.859912246907557
1013
+ - type: nauc_mrr_at_1_diff1
1014
+ value: 89.97737048914607
1015
+ - type: nauc_mrr_at_1_max
1016
+ value: 71.45737401142345
1017
+ - type: nauc_mrr_at_1_std
1018
+ value: 4.759040523357649
1019
+ - type: nauc_mrr_at_20_diff1
1020
+ value: 88.77444892974766
1021
+ - type: nauc_mrr_at_20_max
1022
+ value: 74.02582129341143
1023
+ - type: nauc_mrr_at_20_std
1024
+ value: 8.540371486769867
1025
+ - type: nauc_mrr_at_3_diff1
1026
+ value: 88.63122911038182
1027
+ - type: nauc_mrr_at_3_max
1028
+ value: 74.00939999585503
1029
+ - type: nauc_mrr_at_3_std
1030
+ value: 8.800123446309959
1031
+ - type: nauc_mrr_at_5_diff1
1032
+ value: 88.60660773314059
1033
+ - type: nauc_mrr_at_5_max
1034
+ value: 74.22116501727933
1035
+ - type: nauc_mrr_at_5_std
1036
+ value: 9.32259867764275
1037
+ - type: nauc_ndcg_at_1000_diff1
1038
+ value: 88.63409129211333
1039
+ - type: nauc_ndcg_at_1000_max
1040
+ value: 74.5309057755214
1041
+ - type: nauc_ndcg_at_1000_std
1042
+ value: 9.413371605896351
1043
+ - type: nauc_ndcg_at_100_diff1
1044
+ value: 88.59861614511203
1045
+ - type: nauc_ndcg_at_100_max
1046
+ value: 74.70664505666113
1047
+ - type: nauc_ndcg_at_100_std
1048
+ value: 9.763156219113043
1049
+ - type: nauc_ndcg_at_10_diff1
1050
+ value: 88.1528125374064
1051
+ - type: nauc_ndcg_at_10_max
1052
+ value: 75.41722645550642
1053
+ - type: nauc_ndcg_at_10_std
1054
+ value: 10.681431101624623
1055
+ - type: nauc_ndcg_at_1_diff1
1056
+ value: 89.97737048914607
1057
+ - type: nauc_ndcg_at_1_max
1058
+ value: 71.45737401142345
1059
+ - type: nauc_ndcg_at_1_std
1060
+ value: 4.759040523357649
1061
+ - type: nauc_ndcg_at_20_diff1
1062
+ value: 88.50160845988172
1063
+ - type: nauc_ndcg_at_20_max
1064
+ value: 74.96664595209074
1065
+ - type: nauc_ndcg_at_20_std
1066
+ value: 9.380512837396632
1067
+ - type: nauc_ndcg_at_3_diff1
1068
+ value: 88.05768683477201
1069
+ - type: nauc_ndcg_at_3_max
1070
+ value: 75.02313831321838
1071
+ - type: nauc_ndcg_at_3_std
1072
+ value: 10.537764520686949
1073
+ - type: nauc_ndcg_at_5_diff1
1074
+ value: 87.97191682703232
1075
+ - type: nauc_ndcg_at_5_max
1076
+ value: 75.52848194372503
1077
+ - type: nauc_ndcg_at_5_std
1078
+ value: 11.774494710346415
1079
+ - type: nauc_precision_at_1000_diff1
1080
+ value: 100.0
1081
+ - type: nauc_precision_at_1000_max
1082
+ value: 95.64221684222578
1083
+ - type: nauc_precision_at_1000_std
1084
+ value: 90.73902903394449
1085
+ - type: nauc_precision_at_100_diff1
1086
+ value: 87.42504295503302
1087
+ - type: nauc_precision_at_100_max
1088
+ value: 92.05171886330325
1089
+ - type: nauc_precision_at_100_std
1090
+ value: 52.07235965498117
1091
+ - type: nauc_precision_at_10_diff1
1092
+ value: 84.8336822266199
1093
+ - type: nauc_precision_at_10_max
1094
+ value: 83.65267406867247
1095
+ - type: nauc_precision_at_10_std
1096
+ value: 21.99447008561385
1097
+ - type: nauc_precision_at_1_diff1
1098
+ value: 89.97737048914607
1099
+ - type: nauc_precision_at_1_max
1100
+ value: 71.45737401142345
1101
+ - type: nauc_precision_at_1_std
1102
+ value: 4.759040523357649
1103
+ - type: nauc_precision_at_20_diff1
1104
+ value: 86.96846782406944
1105
+ - type: nauc_precision_at_20_max
1106
+ value: 82.96275580308742
1107
+ - type: nauc_precision_at_20_std
1108
+ value: 13.610628290924112
1109
+ - type: nauc_precision_at_3_diff1
1110
+ value: 85.85061149321128
1111
+ - type: nauc_precision_at_3_max
1112
+ value: 78.89652765257202
1113
+ - type: nauc_precision_at_3_std
1114
+ value: 17.23042587138826
1115
+ - type: nauc_precision_at_5_diff1
1116
+ value: 84.94624842605198
1117
+ - type: nauc_precision_at_5_max
1118
+ value: 81.81787797176683
1119
+ - type: nauc_precision_at_5_std
1120
+ value: 23.760497470734563
1121
+ - type: nauc_recall_at_1000_diff1
1122
+ value: 100.0
1123
+ - type: nauc_recall_at_1000_max
1124
+ value: 95.64221684223966
1125
+ - type: nauc_recall_at_1000_std
1126
+ value: 90.73902903396089
1127
+ - type: nauc_recall_at_100_diff1
1128
+ value: 87.42504295503399
1129
+ - type: nauc_recall_at_100_max
1130
+ value: 92.0517188633039
1131
+ - type: nauc_recall_at_100_std
1132
+ value: 52.07235965498028
1133
+ - type: nauc_recall_at_10_diff1
1134
+ value: 84.83368222661971
1135
+ - type: nauc_recall_at_10_max
1136
+ value: 83.65267406867238
1137
+ - type: nauc_recall_at_10_std
1138
+ value: 21.99447008561354
1139
+ - type: nauc_recall_at_1_diff1
1140
+ value: 89.97737048914607
1141
+ - type: nauc_recall_at_1_max
1142
+ value: 71.45737401142345
1143
+ - type: nauc_recall_at_1_std
1144
+ value: 4.759040523357649
1145
+ - type: nauc_recall_at_20_diff1
1146
+ value: 86.96846782406952
1147
+ - type: nauc_recall_at_20_max
1148
+ value: 82.96275580308719
1149
+ - type: nauc_recall_at_20_std
1150
+ value: 13.610628290923948
1151
+ - type: nauc_recall_at_3_diff1
1152
+ value: 85.85061149321133
1153
+ - type: nauc_recall_at_3_max
1154
+ value: 78.89652765257206
1155
+ - type: nauc_recall_at_3_std
1156
+ value: 17.23042587138828
1157
+ - type: nauc_recall_at_5_diff1
1158
+ value: 84.94624842605192
1159
+ - type: nauc_recall_at_5_max
1160
+ value: 81.81787797176689
1161
+ - type: nauc_recall_at_5_std
1162
+ value: 23.760497470734606
1163
+ - type: ndcg_at_1
1164
+ value: 80.28
1165
+ - type: ndcg_at_10
1166
+ value: 86.997
1167
+ - type: ndcg_at_100
1168
+ value: 88.161
1169
+ - type: ndcg_at_1000
1170
+ value: 88.28200000000001
1171
+ - type: ndcg_at_20
1172
+ value: 87.566
1173
+ - type: ndcg_at_3
1174
+ value: 85.064
1175
+ - type: ndcg_at_5
1176
+ value: 86.195
1177
+ - type: precision_at_1
1178
+ value: 80.28
1179
+ - type: precision_at_10
1180
+ value: 9.349
1181
+ - type: precision_at_100
1182
+ value: 0.989
1183
+ - type: precision_at_1000
1184
+ value: 0.1
1185
+ - type: precision_at_20
1186
+ value: 4.787
1187
+ - type: precision_at_3
1188
+ value: 29.429
1189
+ - type: precision_at_5
1190
+ value: 18.208
1191
+ - type: recall_at_1
1192
+ value: 80.28
1193
+ - type: recall_at_10
1194
+ value: 93.49300000000001
1195
+ - type: recall_at_100
1196
+ value: 98.899
1197
+ - type: recall_at_1000
1198
+ value: 99.85000000000001
1199
+ - type: recall_at_20
1200
+ value: 95.746
1201
+ - type: recall_at_3
1202
+ value: 88.288
1203
+ - type: recall_at_5
1204
+ value: 91.04100000000001
1205
+ task:
1206
+ type: Retrieval
1207
+ - dataset:
1208
+ config: hu
1209
+ name: MTEB MassiveIntentClassification (hu)
1210
+ revision: 4672e20407010da34463acc759c162ca9734bca6
1211
+ split: test
1212
+ type: mteb/amazon_massive_intent
1213
+ metrics:
1214
+ - type: accuracy
1215
+ value: 55.823806321452594
1216
+ - type: f1
1217
+ value: 50.78756643922222
1218
+ - type: f1_weighted
1219
+ value: 55.11520680706619
1220
+ - type: main_score
1221
+ value: 55.823806321452594
1222
+ task:
1223
+ type: Classification
1224
+ - dataset:
1225
+ config: hu
1226
+ name: MTEB MassiveIntentClassification (hu)
1227
+ revision: 4672e20407010da34463acc759c162ca9734bca6
1228
+ split: validation
1229
+ type: mteb/amazon_massive_intent
1230
+ metrics:
1231
+ - type: accuracy
1232
+ value: 54.66797835710773
1233
+ - type: f1
1234
+ value: 49.5096347438473
1235
+ - type: f1_weighted
1236
+ value: 53.73310190085533
1237
+ - type: main_score
1238
+ value: 54.66797835710773
1239
+ task:
1240
+ type: Classification
1241
+ - dataset:
1242
+ config: hu
1243
+ name: MTEB MassiveScenarioClassification (hu)
1244
+ revision: fad2c6e8459f9e1c45d9315f4953d921437d70f8
1245
+ split: test
1246
+ type: mteb/amazon_massive_scenario
1247
+ metrics:
1248
+ - type: accuracy
1249
+ value: 63.37256220578345
1250
+ - type: f1
1251
+ value: 61.58399629628825
1252
+ - type: f1_weighted
1253
+ value: 63.13464436259451
1254
+ - type: main_score
1255
+ value: 63.37256220578345
1256
+ task:
1257
+ type: Classification
1258
+ - dataset:
1259
+ config: hu
1260
+ name: MTEB MassiveScenarioClassification (hu)
1261
+ revision: fad2c6e8459f9e1c45d9315f4953d921437d70f8
1262
+ split: validation
1263
+ type: mteb/amazon_massive_scenario
1264
+ metrics:
1265
+ - type: accuracy
1266
+ value: 62.03148057058534
1267
+ - type: f1
1268
+ value: 60.9893800714451
1269
+ - type: f1_weighted
1270
+ value: 61.85509382597554
1271
+ - type: main_score
1272
+ value: 62.03148057058534
1273
+ task:
1274
+ type: Classification
1275
+ - dataset:
1276
+ config: hu
1277
+ name: MTEB MultiEURLEXMultilabelClassification (hu)
1278
+ revision: 2aea5a6dc8fdcfeca41d0fb963c0a338930bde5c
1279
+ split: test
1280
+ type: mteb/eurlex-multilingual
1281
+ metrics:
1282
+ - type: accuracy
1283
+ value: 3.0380000000000003
1284
+ - type: f1
1285
+ value: 27.32839484028383
1286
+ - type: lrap
1287
+ value: 41.09644076719448
1288
+ - type: main_score
1289
+ value: 3.0380000000000003
1290
+ task:
1291
+ type: MultilabelClassification
1292
+ - dataset:
1293
+ config: arb_Arab-hun_Latn
1294
+ name: MTEB NTREXBitextMining (arb_Arab-hun_Latn)
1295
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1296
+ split: test
1297
+ type: mteb/NTREX
1298
+ metrics:
1299
+ - type: accuracy
1300
+ value: 83.07461191787682
1301
+ - type: f1
1302
+ value: 78.97012184944082
1303
+ - type: main_score
1304
+ value: 78.97012184944082
1305
+ - type: precision
1306
+ value: 77.16324486730095
1307
+ - type: recall
1308
+ value: 83.07461191787682
1309
+ task:
1310
+ type: BitextMining
1311
+ - dataset:
1312
+ config: ben_Beng-hun_Latn
1313
+ name: MTEB NTREXBitextMining (ben_Beng-hun_Latn)
1314
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1315
+ split: test
1316
+ type: mteb/NTREX
1317
+ metrics:
1318
+ - type: accuracy
1319
+ value: 81.2719078617927
1320
+ - type: f1
1321
+ value: 76.6133724396118
1322
+ - type: main_score
1323
+ value: 76.6133724396118
1324
+ - type: precision
1325
+ value: 74.5247633354794
1326
+ - type: recall
1327
+ value: 81.2719078617927
1328
+ task:
1329
+ type: BitextMining
1330
+ - dataset:
1331
+ config: deu_Latn-hun_Latn
1332
+ name: MTEB NTREXBitextMining (deu_Latn-hun_Latn)
1333
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1334
+ split: test
1335
+ type: mteb/NTREX
1336
+ metrics:
1337
+ - type: accuracy
1338
+ value: 90.78617926890335
1339
+ - type: f1
1340
+ value: 88.27073944249707
1341
+ - type: main_score
1342
+ value: 88.27073944249707
1343
+ - type: precision
1344
+ value: 87.1056584877316
1345
+ - type: recall
1346
+ value: 90.78617926890335
1347
+ task:
1348
+ type: BitextMining
1349
+ - dataset:
1350
+ config: ell_Grek-hun_Latn
1351
+ name: MTEB NTREXBitextMining (ell_Grek-hun_Latn)
1352
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1353
+ split: test
1354
+ type: mteb/NTREX
1355
+ metrics:
1356
+ - type: accuracy
1357
+ value: 89.08362543815723
1358
+ - type: f1
1359
+ value: 86.19429143715574
1360
+ - type: main_score
1361
+ value: 86.19429143715574
1362
+ - type: precision
1363
+ value: 84.85728592889333
1364
+ - type: recall
1365
+ value: 89.08362543815723
1366
+ task:
1367
+ type: BitextMining
1368
+ - dataset:
1369
+ config: eng_Latn-hun_Latn
1370
+ name: MTEB NTREXBitextMining (eng_Latn-hun_Latn)
1371
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1372
+ split: test
1373
+ type: mteb/NTREX
1374
+ metrics:
1375
+ - type: accuracy
1376
+ value: 93.23985978968453
1377
+ - type: f1
1378
+ value: 91.4087798364213
1379
+ - type: main_score
1380
+ value: 91.4087798364213
1381
+ - type: precision
1382
+ value: 90.57753296611585
1383
+ - type: recall
1384
+ value: 93.23985978968453
1385
+ task:
1386
+ type: BitextMining
1387
+ - dataset:
1388
+ config: fas_Arab-hun_Latn
1389
+ name: MTEB NTREXBitextMining (fas_Arab-hun_Latn)
1390
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1391
+ split: test
1392
+ type: mteb/NTREX
1393
+ metrics:
1394
+ - type: accuracy
1395
+ value: 86.37956935403105
1396
+ - type: f1
1397
+ value: 82.8442663995994
1398
+ - type: main_score
1399
+ value: 82.8442663995994
1400
+ - type: precision
1401
+ value: 81.2635620096812
1402
+ - type: recall
1403
+ value: 86.37956935403105
1404
+ task:
1405
+ type: BitextMining
1406
+ - dataset:
1407
+ config: fin_Latn-hun_Latn
1408
+ name: MTEB NTREXBitextMining (fin_Latn-hun_Latn)
1409
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1410
+ split: test
1411
+ type: mteb/NTREX
1412
+ metrics:
1413
+ - type: accuracy
1414
+ value: 85.42814221331997
1415
+ - type: f1
1416
+ value: 81.80031952690942
1417
+ - type: main_score
1418
+ value: 81.80031952690942
1419
+ - type: precision
1420
+ value: 80.1235186112502
1421
+ - type: recall
1422
+ value: 85.42814221331997
1423
+ task:
1424
+ type: BitextMining
1425
+ - dataset:
1426
+ config: fra_Latn-hun_Latn
1427
+ name: MTEB NTREXBitextMining (fra_Latn-hun_Latn)
1428
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1429
+ split: test
1430
+ type: mteb/NTREX
1431
+ metrics:
1432
+ - type: accuracy
1433
+ value: 90.83625438157236
1434
+ - type: f1
1435
+ value: 88.31079953263227
1436
+ - type: main_score
1437
+ value: 88.31079953263227
1438
+ - type: precision
1439
+ value: 87.11817726589885
1440
+ - type: recall
1441
+ value: 90.83625438157236
1442
+ task:
1443
+ type: BitextMining
1444
+ - dataset:
1445
+ config: heb_Hebr-hun_Latn
1446
+ name: MTEB NTREXBitextMining (heb_Hebr-hun_Latn)
1447
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1448
+ split: test
1449
+ type: mteb/NTREX
1450
+ metrics:
1451
+ - type: accuracy
1452
+ value: 81.32198297446169
1453
+ - type: f1
1454
+ value: 76.4972458688032
1455
+ - type: main_score
1456
+ value: 76.4972458688032
1457
+ - type: precision
1458
+ value: 74.3578462932494
1459
+ - type: recall
1460
+ value: 81.32198297446169
1461
+ task:
1462
+ type: BitextMining
1463
+ - dataset:
1464
+ config: hin_Deva-hun_Latn
1465
+ name: MTEB NTREXBitextMining (hin_Deva-hun_Latn)
1466
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1467
+ split: test
1468
+ type: mteb/NTREX
1469
+ metrics:
1470
+ - type: accuracy
1471
+ value: 86.37956935403105
1472
+ - type: f1
1473
+ value: 82.83341679185445
1474
+ - type: main_score
1475
+ value: 82.83341679185445
1476
+ - type: precision
1477
+ value: 81.21563297326942
1478
+ - type: recall
1479
+ value: 86.37956935403105
1480
+ task:
1481
+ type: BitextMining
1482
+ - dataset:
1483
+ config: hun_Latn-arb_Arab
1484
+ name: MTEB NTREXBitextMining (hun_Latn-arb_Arab)
1485
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1486
+ split: test
1487
+ type: mteb/NTREX
1488
+ metrics:
1489
+ - type: accuracy
1490
+ value: 82.22333500250375
1491
+ - type: f1
1492
+ value: 77.76760378663232
1493
+ - type: main_score
1494
+ value: 77.76760378663232
1495
+ - type: precision
1496
+ value: 75.81634356296348
1497
+ - type: recall
1498
+ value: 82.22333500250375
1499
+ task:
1500
+ type: BitextMining
1501
+ - dataset:
1502
+ config: hun_Latn-ben_Beng
1503
+ name: MTEB NTREXBitextMining (hun_Latn-ben_Beng)
1504
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1505
+ split: test
1506
+ type: mteb/NTREX
1507
+ metrics:
1508
+ - type: accuracy
1509
+ value: 77.56634952428642
1510
+ - type: f1
1511
+ value: 72.28537250319926
1512
+ - type: main_score
1513
+ value: 72.28537250319926
1514
+ - type: precision
1515
+ value: 70.02032811121445
1516
+ - type: recall
1517
+ value: 77.56634952428642
1518
+ task:
1519
+ type: BitextMining
1520
+ - dataset:
1521
+ config: hun_Latn-deu_Latn
1522
+ name: MTEB NTREXBitextMining (hun_Latn-deu_Latn)
1523
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1524
+ split: test
1525
+ type: mteb/NTREX
1526
+ metrics:
1527
+ - type: accuracy
1528
+ value: 91.4371557336004
1529
+ - type: f1
1530
+ value: 89.27391086629945
1531
+ - type: main_score
1532
+ value: 89.27391086629945
1533
+ - type: precision
1534
+ value: 88.24904022700719
1535
+ - type: recall
1536
+ value: 91.4371557336004
1537
+ task:
1538
+ type: BitextMining
1539
+ - dataset:
1540
+ config: hun_Latn-ell_Grek
1541
+ name: MTEB NTREXBitextMining (hun_Latn-ell_Grek)
1542
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1543
+ split: test
1544
+ type: mteb/NTREX
1545
+ metrics:
1546
+ - type: accuracy
1547
+ value: 88.3825738607912
1548
+ - type: f1
1549
+ value: 85.36900588978705
1550
+ - type: main_score
1551
+ value: 85.36900588978705
1552
+ - type: precision
1553
+ value: 83.98848272408614
1554
+ - type: recall
1555
+ value: 88.3825738607912
1556
+ task:
1557
+ type: BitextMining
1558
+ - dataset:
1559
+ config: hun_Latn-eng_Latn
1560
+ name: MTEB NTREXBitextMining (hun_Latn-eng_Latn)
1561
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1562
+ split: test
1563
+ type: mteb/NTREX
1564
+ metrics:
1565
+ - type: accuracy
1566
+ value: 94.2914371557336
1567
+ - type: f1
1568
+ value: 92.68903355032549
1569
+ - type: main_score
1570
+ value: 92.68903355032549
1571
+ - type: precision
1572
+ value: 91.92121515606743
1573
+ - type: recall
1574
+ value: 94.2914371557336
1575
+ task:
1576
+ type: BitextMining
1577
+ - dataset:
1578
+ config: hun_Latn-fas_Arab
1579
+ name: MTEB NTREXBitextMining (hun_Latn-fas_Arab)
1580
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1581
+ split: test
1582
+ type: mteb/NTREX
1583
+ metrics:
1584
+ - type: accuracy
1585
+ value: 84.72709063595393
1586
+ - type: f1
1587
+ value: 80.81622433650475
1588
+ - type: main_score
1589
+ value: 80.81622433650475
1590
+ - type: precision
1591
+ value: 79.05524954097814
1592
+ - type: recall
1593
+ value: 84.72709063595393
1594
+ task:
1595
+ type: BitextMining
1596
+ - dataset:
1597
+ config: hun_Latn-fin_Latn
1598
+ name: MTEB NTREXBitextMining (hun_Latn-fin_Latn)
1599
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1600
+ split: test
1601
+ type: mteb/NTREX
1602
+ metrics:
1603
+ - type: accuracy
1604
+ value: 83.57536304456686
1605
+ - type: f1
1606
+ value: 79.32338984667477
1607
+ - type: main_score
1608
+ value: 79.32338984667477
1609
+ - type: precision
1610
+ value: 77.45833035267187
1611
+ - type: recall
1612
+ value: 83.57536304456686
1613
+ task:
1614
+ type: BitextMining
1615
+ - dataset:
1616
+ config: hun_Latn-fra_Latn
1617
+ name: MTEB NTREXBitextMining (hun_Latn-fra_Latn)
1618
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1619
+ split: test
1620
+ type: mteb/NTREX
1621
+ metrics:
1622
+ - type: accuracy
1623
+ value: 90.48572859288933
1624
+ - type: f1
1625
+ value: 87.94954336266304
1626
+ - type: main_score
1627
+ value: 87.94954336266304
1628
+ - type: precision
1629
+ value: 86.75429811383744
1630
+ - type: recall
1631
+ value: 90.48572859288933
1632
+ task:
1633
+ type: BitextMining
1634
+ - dataset:
1635
+ config: hun_Latn-heb_Hebr
1636
+ name: MTEB NTREXBitextMining (hun_Latn-heb_Hebr)
1637
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1638
+ split: test
1639
+ type: mteb/NTREX
1640
+ metrics:
1641
+ - type: accuracy
1642
+ value: 77.21582373560341
1643
+ - type: f1
1644
+ value: 71.82277384330463
1645
+ - type: main_score
1646
+ value: 71.82277384330463
1647
+ - type: precision
1648
+ value: 69.55856403653098
1649
+ - type: recall
1650
+ value: 77.21582373560341
1651
+ task:
1652
+ type: BitextMining
1653
+ - dataset:
1654
+ config: hun_Latn-hin_Deva
1655
+ name: MTEB NTREXBitextMining (hun_Latn-hin_Deva)
1656
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1657
+ split: test
1658
+ type: mteb/NTREX
1659
+ metrics:
1660
+ - type: accuracy
1661
+ value: 84.77716574862293
1662
+ - type: f1
1663
+ value: 80.97423913648251
1664
+ - type: main_score
1665
+ value: 80.97423913648251
1666
+ - type: precision
1667
+ value: 79.27265898848273
1668
+ - type: recall
1669
+ value: 84.77716574862293
1670
+ task:
1671
+ type: BitextMining
1672
+ - dataset:
1673
+ config: hun_Latn-ind_Latn
1674
+ name: MTEB NTREXBitextMining (hun_Latn-ind_Latn)
1675
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1676
+ split: test
1677
+ type: mteb/NTREX
1678
+ metrics:
1679
+ - type: accuracy
1680
+ value: 90.0350525788683
1681
+ - type: f1
1682
+ value: 87.28592889334
1683
+ - type: main_score
1684
+ value: 87.28592889334
1685
+ - type: precision
1686
+ value: 85.99732932732432
1687
+ - type: recall
1688
+ value: 90.0350525788683
1689
+ task:
1690
+ type: BitextMining
1691
+ - dataset:
1692
+ config: hun_Latn-jpn_Jpan
1693
+ name: MTEB NTREXBitextMining (hun_Latn-jpn_Jpan)
1694
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1695
+ split: test
1696
+ type: mteb/NTREX
1697
+ metrics:
1698
+ - type: accuracy
1699
+ value: 84.37656484727091
1700
+ - type: f1
1701
+ value: 80.59017097074182
1702
+ - type: main_score
1703
+ value: 80.59017097074182
1704
+ - type: precision
1705
+ value: 78.94508429310633
1706
+ - type: recall
1707
+ value: 84.37656484727091
1708
+ task:
1709
+ type: BitextMining
1710
+ - dataset:
1711
+ config: hun_Latn-kor_Hang
1712
+ name: MTEB NTREXBitextMining (hun_Latn-kor_Hang)
1713
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1714
+ split: test
1715
+ type: mteb/NTREX
1716
+ metrics:
1717
+ - type: accuracy
1718
+ value: 80.77115673510265
1719
+ - type: f1
1720
+ value: 76.35683684256543
1721
+ - type: main_score
1722
+ value: 76.35683684256543
1723
+ - type: precision
1724
+ value: 74.47361699114327
1725
+ - type: recall
1726
+ value: 80.77115673510265
1727
+ task:
1728
+ type: BitextMining
1729
+ - dataset:
1730
+ config: hun_Latn-lav_Latn
1731
+ name: MTEB NTREXBitextMining (hun_Latn-lav_Latn)
1732
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1733
+ split: test
1734
+ type: mteb/NTREX
1735
+ metrics:
1736
+ - type: accuracy
1737
+ value: 76.81522283425137
1738
+ - type: f1
1739
+ value: 71.24067052960392
1740
+ - type: main_score
1741
+ value: 71.24067052960392
1742
+ - type: precision
1743
+ value: 68.94003703968652
1744
+ - type: recall
1745
+ value: 76.81522283425137
1746
+ task:
1747
+ type: BitextMining
1748
+ - dataset:
1749
+ config: hun_Latn-lit_Latn
1750
+ name: MTEB NTREXBitextMining (hun_Latn-lit_Latn)
1751
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1752
+ split: test
1753
+ type: mteb/NTREX
1754
+ metrics:
1755
+ - type: accuracy
1756
+ value: 77.3159739609414
1757
+ - type: f1
1758
+ value: 71.92622266733433
1759
+ - type: main_score
1760
+ value: 71.92622266733433
1761
+ - type: precision
1762
+ value: 69.58461501776473
1763
+ - type: recall
1764
+ value: 77.3159739609414
1765
+ task:
1766
+ type: BitextMining
1767
+ - dataset:
1768
+ config: hun_Latn-nld_Latn
1769
+ name: MTEB NTREXBitextMining (hun_Latn-nld_Latn)
1770
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1771
+ split: test
1772
+ type: mteb/NTREX
1773
+ metrics:
1774
+ - type: accuracy
1775
+ value: 90.98647971957938
1776
+ - type: f1
1777
+ value: 88.5027541311968
1778
+ - type: main_score
1779
+ value: 88.5027541311968
1780
+ - type: precision
1781
+ value: 87.33683859122017
1782
+ - type: recall
1783
+ value: 90.98647971957938
1784
+ task:
1785
+ type: BitextMining
1786
+ - dataset:
1787
+ config: hun_Latn-pol_Latn
1788
+ name: MTEB NTREXBitextMining (hun_Latn-pol_Latn)
1789
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1790
+ split: test
1791
+ type: mteb/NTREX
1792
+ metrics:
1793
+ - type: accuracy
1794
+ value: 88.43264897346019
1795
+ - type: f1
1796
+ value: 85.33896082218565
1797
+ - type: main_score
1798
+ value: 85.33896082218565
1799
+ - type: precision
1800
+ value: 83.90919712902688
1801
+ - type: recall
1802
+ value: 88.43264897346019
1803
+ task:
1804
+ type: BitextMining
1805
+ - dataset:
1806
+ config: hun_Latn-por_Latn
1807
+ name: MTEB NTREXBitextMining (hun_Latn-por_Latn)
1808
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1809
+ split: test
1810
+ type: mteb/NTREX
1811
+ metrics:
1812
+ - type: accuracy
1813
+ value: 90.68602904356536
1814
+ - type: f1
1815
+ value: 88.09046903688868
1816
+ - type: main_score
1817
+ value: 88.09046903688868
1818
+ - type: precision
1819
+ value: 86.88449340677683
1820
+ - type: recall
1821
+ value: 90.68602904356536
1822
+ task:
1823
+ type: BitextMining
1824
+ - dataset:
1825
+ config: hun_Latn-rus_Cyrl
1826
+ name: MTEB NTREXBitextMining (hun_Latn-rus_Cyrl)
1827
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1828
+ split: test
1829
+ type: mteb/NTREX
1830
+ metrics:
1831
+ - type: accuracy
1832
+ value: 90.0350525788683
1833
+ - type: f1
1834
+ value: 87.35770322149892
1835
+ - type: main_score
1836
+ value: 87.35770322149892
1837
+ - type: precision
1838
+ value: 86.10832916040727
1839
+ - type: recall
1840
+ value: 90.0350525788683
1841
+ task:
1842
+ type: BitextMining
1843
+ - dataset:
1844
+ config: hun_Latn-spa_Latn
1845
+ name: MTEB NTREXBitextMining (hun_Latn-spa_Latn)
1846
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1847
+ split: test
1848
+ type: mteb/NTREX
1849
+ metrics:
1850
+ - type: accuracy
1851
+ value: 92.58888332498748
1852
+ - type: f1
1853
+ value: 90.64763812385245
1854
+ - type: main_score
1855
+ value: 90.64763812385245
1856
+ - type: precision
1857
+ value: 89.75880487397765
1858
+ - type: recall
1859
+ value: 92.58888332498748
1860
+ task:
1861
+ type: BitextMining
1862
+ - dataset:
1863
+ config: hun_Latn-swa_Latn
1864
+ name: MTEB NTREXBitextMining (hun_Latn-swa_Latn)
1865
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1866
+ split: test
1867
+ type: mteb/NTREX
1868
+ metrics:
1869
+ - type: accuracy
1870
+ value: 72.60891337005508
1871
+ - type: f1
1872
+ value: 66.62728580605396
1873
+ - type: main_score
1874
+ value: 66.62728580605396
1875
+ - type: precision
1876
+ value: 64.22842597229177
1877
+ - type: recall
1878
+ value: 72.60891337005508
1879
+ task:
1880
+ type: BitextMining
1881
+ - dataset:
1882
+ config: hun_Latn-swe_Latn
1883
+ name: MTEB NTREXBitextMining (hun_Latn-swe_Latn)
1884
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1885
+ split: test
1886
+ type: mteb/NTREX
1887
+ metrics:
1888
+ - type: accuracy
1889
+ value: 89.03355032548824
1890
+ - type: f1
1891
+ value: 86.01569020196962
1892
+ - type: main_score
1893
+ value: 86.01569020196962
1894
+ - type: precision
1895
+ value: 84.59105324653648
1896
+ - type: recall
1897
+ value: 89.03355032548824
1898
+ task:
1899
+ type: BitextMining
1900
+ - dataset:
1901
+ config: hun_Latn-tam_Taml
1902
+ name: MTEB NTREXBitextMining (hun_Latn-tam_Taml)
1903
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1904
+ split: test
1905
+ type: mteb/NTREX
1906
+ metrics:
1907
+ - type: accuracy
1908
+ value: 74.66199298948423
1909
+ - type: f1
1910
+ value: 68.7971639999682
1911
+ - type: main_score
1912
+ value: 68.7971639999682
1913
+ - type: precision
1914
+ value: 66.36091041323891
1915
+ - type: recall
1916
+ value: 74.66199298948423
1917
+ task:
1918
+ type: BitextMining
1919
+ - dataset:
1920
+ config: hun_Latn-tur_Latn
1921
+ name: MTEB NTREXBitextMining (hun_Latn-tur_Latn)
1922
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1923
+ split: test
1924
+ type: mteb/NTREX
1925
+ metrics:
1926
+ - type: accuracy
1927
+ value: 87.08062093139709
1928
+ - type: f1
1929
+ value: 83.79736271073277
1930
+ - type: main_score
1931
+ value: 83.79736271073277
1932
+ - type: precision
1933
+ value: 82.33278489162315
1934
+ - type: recall
1935
+ value: 87.08062093139709
1936
+ task:
1937
+ type: BitextMining
1938
+ - dataset:
1939
+ config: hun_Latn-vie_Latn
1940
+ name: MTEB NTREXBitextMining (hun_Latn-vie_Latn)
1941
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1942
+ split: test
1943
+ type: mteb/NTREX
1944
+ metrics:
1945
+ - type: accuracy
1946
+ value: 89.78467701552329
1947
+ - type: f1
1948
+ value: 87.0288766483058
1949
+ - type: main_score
1950
+ value: 87.0288766483058
1951
+ - type: precision
1952
+ value: 85.76781839425806
1953
+ - type: recall
1954
+ value: 89.78467701552329
1955
+ task:
1956
+ type: BitextMining
1957
+ - dataset:
1958
+ config: hun_Latn-zho_Hant
1959
+ name: MTEB NTREXBitextMining (hun_Latn-zho_Hant)
1960
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1961
+ split: test
1962
+ type: mteb/NTREX
1963
+ metrics:
1964
+ - type: accuracy
1965
+ value: 87.33099649474211
1966
+ - type: f1
1967
+ value: 84.02103154732097
1968
+ - type: main_score
1969
+ value: 84.02103154732097
1970
+ - type: precision
1971
+ value: 82.51877816725089
1972
+ - type: recall
1973
+ value: 87.33099649474211
1974
+ task:
1975
+ type: BitextMining
1976
+ - dataset:
1977
+ config: hun_Latn-zul_Latn
1978
+ name: MTEB NTREXBitextMining (hun_Latn-zul_Latn)
1979
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1980
+ split: test
1981
+ type: mteb/NTREX
1982
+ metrics:
1983
+ - type: accuracy
1984
+ value: 51.92789183775663
1985
+ - type: f1
1986
+ value: 43.912175926815536
1987
+ - type: main_score
1988
+ value: 43.912175926815536
1989
+ - type: precision
1990
+ value: 41.09881091478487
1991
+ - type: recall
1992
+ value: 51.92789183775663
1993
+ task:
1994
+ type: BitextMining
1995
+ - dataset:
1996
+ config: ind_Latn-hun_Latn
1997
+ name: MTEB NTREXBitextMining (ind_Latn-hun_Latn)
1998
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
1999
+ split: test
2000
+ type: mteb/NTREX
2001
+ metrics:
2002
+ - type: accuracy
2003
+ value: 90.1352028042063
2004
+ - type: f1
2005
+ value: 87.51722822328732
2006
+ - type: main_score
2007
+ value: 87.51722822328732
2008
+ - type: precision
2009
+ value: 86.31280253713905
2010
+ - type: recall
2011
+ value: 90.1352028042063
2012
+ task:
2013
+ type: BitextMining
2014
+ - dataset:
2015
+ config: jpn_Jpan-hun_Latn
2016
+ name: MTEB NTREXBitextMining (jpn_Jpan-hun_Latn)
2017
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2018
+ split: test
2019
+ type: mteb/NTREX
2020
+ metrics:
2021
+ - type: accuracy
2022
+ value: 84.37656484727091
2023
+ - type: f1
2024
+ value: 80.56084126189283
2025
+ - type: main_score
2026
+ value: 80.56084126189283
2027
+ - type: precision
2028
+ value: 78.84743782340176
2029
+ - type: recall
2030
+ value: 84.37656484727091
2031
+ task:
2032
+ type: BitextMining
2033
+ - dataset:
2034
+ config: kor_Hang-hun_Latn
2035
+ name: MTEB NTREXBitextMining (kor_Hang-hun_Latn)
2036
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2037
+ split: test
2038
+ type: mteb/NTREX
2039
+ metrics:
2040
+ - type: accuracy
2041
+ value: 83.47521281922884
2042
+ - type: f1
2043
+ value: 79.41519421990128
2044
+ - type: main_score
2045
+ value: 79.41519421990128
2046
+ - type: precision
2047
+ value: 77.57350311181057
2048
+ - type: recall
2049
+ value: 83.47521281922884
2050
+ task:
2051
+ type: BitextMining
2052
+ - dataset:
2053
+ config: lav_Latn-hun_Latn
2054
+ name: MTEB NTREXBitextMining (lav_Latn-hun_Latn)
2055
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2056
+ split: test
2057
+ type: mteb/NTREX
2058
+ metrics:
2059
+ - type: accuracy
2060
+ value: 82.12318477716575
2061
+ - type: f1
2062
+ value: 78.18656556262967
2063
+ - type: main_score
2064
+ value: 78.18656556262967
2065
+ - type: precision
2066
+ value: 76.41879485895511
2067
+ - type: recall
2068
+ value: 82.12318477716575
2069
+ task:
2070
+ type: BitextMining
2071
+ - dataset:
2072
+ config: lit_Latn-hun_Latn
2073
+ name: MTEB NTREXBitextMining (lit_Latn-hun_Latn)
2074
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2075
+ split: test
2076
+ type: mteb/NTREX
2077
+ metrics:
2078
+ - type: accuracy
2079
+ value: 81.67250876314472
2080
+ - type: f1
2081
+ value: 77.52628943415122
2082
+ - type: main_score
2083
+ value: 77.52628943415122
2084
+ - type: precision
2085
+ value: 75.62426973794024
2086
+ - type: recall
2087
+ value: 81.67250876314472
2088
+ task:
2089
+ type: BitextMining
2090
+ - dataset:
2091
+ config: nld_Latn-hun_Latn
2092
+ name: MTEB NTREXBitextMining (nld_Latn-hun_Latn)
2093
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2094
+ split: test
2095
+ type: mteb/NTREX
2096
+ metrics:
2097
+ - type: accuracy
2098
+ value: 91.03655483224837
2099
+ - type: f1
2100
+ value: 88.62404718188392
2101
+ - type: main_score
2102
+ value: 88.62404718188392
2103
+ - type: precision
2104
+ value: 87.50584209647806
2105
+ - type: recall
2106
+ value: 91.03655483224837
2107
+ task:
2108
+ type: BitextMining
2109
+ - dataset:
2110
+ config: pol_Latn-hun_Latn
2111
+ name: MTEB NTREXBitextMining (pol_Latn-hun_Latn)
2112
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2113
+ split: test
2114
+ type: mteb/NTREX
2115
+ metrics:
2116
+ - type: accuracy
2117
+ value: 88.73309964947421
2118
+ - type: f1
2119
+ value: 85.63869613944726
2120
+ - type: main_score
2121
+ value: 85.63869613944726
2122
+ - type: precision
2123
+ value: 84.21799365715239
2124
+ - type: recall
2125
+ value: 88.73309964947421
2126
+ task:
2127
+ type: BitextMining
2128
+ - dataset:
2129
+ config: por_Latn-hun_Latn
2130
+ name: MTEB NTREXBitextMining (por_Latn-hun_Latn)
2131
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2132
+ split: test
2133
+ type: mteb/NTREX
2134
+ metrics:
2135
+ - type: accuracy
2136
+ value: 91.03655483224837
2137
+ - type: f1
2138
+ value: 88.54782173259889
2139
+ - type: main_score
2140
+ value: 88.54782173259889
2141
+ - type: precision
2142
+ value: 87.39108662994491
2143
+ - type: recall
2144
+ value: 91.03655483224837
2145
+ task:
2146
+ type: BitextMining
2147
+ - dataset:
2148
+ config: rus_Cyrl-hun_Latn
2149
+ name: MTEB NTREXBitextMining (rus_Cyrl-hun_Latn)
2150
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2151
+ split: test
2152
+ type: mteb/NTREX
2153
+ metrics:
2154
+ - type: accuracy
2155
+ value: 88.88332498748123
2156
+ - type: f1
2157
+ value: 85.8447194601426
2158
+ - type: main_score
2159
+ value: 85.8447194601426
2160
+ - type: precision
2161
+ value: 84.45751961275246
2162
+ - type: recall
2163
+ value: 88.88332498748123
2164
+ task:
2165
+ type: BitextMining
2166
+ - dataset:
2167
+ config: spa_Latn-hun_Latn
2168
+ name: MTEB NTREXBitextMining (spa_Latn-hun_Latn)
2169
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2170
+ split: test
2171
+ type: mteb/NTREX
2172
+ metrics:
2173
+ - type: accuracy
2174
+ value: 92.13820731096645
2175
+ - type: f1
2176
+ value: 89.933233183108
2177
+ - type: main_score
2178
+ value: 89.933233183108
2179
+ - type: precision
2180
+ value: 88.92004673677182
2181
+ - type: recall
2182
+ value: 92.13820731096645
2183
+ task:
2184
+ type: BitextMining
2185
+ - dataset:
2186
+ config: swa_Latn-hun_Latn
2187
+ name: MTEB NTREXBitextMining (swa_Latn-hun_Latn)
2188
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2189
+ split: test
2190
+ type: mteb/NTREX
2191
+ metrics:
2192
+ - type: accuracy
2193
+ value: 75.7636454682023
2194
+ - type: f1
2195
+ value: 71.19297994610965
2196
+ - type: main_score
2197
+ value: 71.19297994610965
2198
+ - type: precision
2199
+ value: 69.29461652796655
2200
+ - type: recall
2201
+ value: 75.7636454682023
2202
+ task:
2203
+ type: BitextMining
2204
+ - dataset:
2205
+ config: swe_Latn-hun_Latn
2206
+ name: MTEB NTREXBitextMining (swe_Latn-hun_Latn)
2207
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2208
+ split: test
2209
+ type: mteb/NTREX
2210
+ metrics:
2211
+ - type: accuracy
2212
+ value: 89.83475212819229
2213
+ - type: f1
2214
+ value: 87.25779144907837
2215
+ - type: main_score
2216
+ value: 87.25779144907837
2217
+ - type: precision
2218
+ value: 86.05408112168253
2219
+ - type: recall
2220
+ value: 89.83475212819229
2221
+ task:
2222
+ type: BitextMining
2223
+ - dataset:
2224
+ config: tam_Taml-hun_Latn
2225
+ name: MTEB NTREXBitextMining (tam_Taml-hun_Latn)
2226
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2227
+ split: test
2228
+ type: mteb/NTREX
2229
+ metrics:
2230
+ - type: accuracy
2231
+ value: 78.01702553830746
2232
+ - type: f1
2233
+ value: 72.70886488462853
2234
+ - type: main_score
2235
+ value: 72.70886488462853
2236
+ - type: precision
2237
+ value: 70.39064549204758
2238
+ - type: recall
2239
+ value: 78.01702553830746
2240
+ task:
2241
+ type: BitextMining
2242
+ - dataset:
2243
+ config: tur_Latn-hun_Latn
2244
+ name: MTEB NTREXBitextMining (tur_Latn-hun_Latn)
2245
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2246
+ split: test
2247
+ type: mteb/NTREX
2248
+ metrics:
2249
+ - type: accuracy
2250
+ value: 87.33099649474211
2251
+ - type: f1
2252
+ value: 84.28094522736485
2253
+ - type: main_score
2254
+ value: 84.28094522736485
2255
+ - type: precision
2256
+ value: 82.89100317142379
2257
+ - type: recall
2258
+ value: 87.33099649474211
2259
+ task:
2260
+ type: BitextMining
2261
+ - dataset:
2262
+ config: vie_Latn-hun_Latn
2263
+ name: MTEB NTREXBitextMining (vie_Latn-hun_Latn)
2264
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2265
+ split: test
2266
+ type: mteb/NTREX
2267
+ metrics:
2268
+ - type: accuracy
2269
+ value: 89.23385077616425
2270
+ - type: f1
2271
+ value: 86.38290769487564
2272
+ - type: main_score
2273
+ value: 86.38290769487564
2274
+ - type: precision
2275
+ value: 85.08763144717074
2276
+ - type: recall
2277
+ value: 89.23385077616425
2278
+ task:
2279
+ type: BitextMining
2280
+ - dataset:
2281
+ config: zho_Hant-hun_Latn
2282
+ name: MTEB NTREXBitextMining (zho_Hant-hun_Latn)
2283
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2284
+ split: test
2285
+ type: mteb/NTREX
2286
+ metrics:
2287
+ - type: accuracy
2288
+ value: 86.52979469203805
2289
+ - type: f1
2290
+ value: 82.964446670005
2291
+ - type: main_score
2292
+ value: 82.964446670005
2293
+ - type: precision
2294
+ value: 81.4104490068436
2295
+ - type: recall
2296
+ value: 86.52979469203805
2297
+ task:
2298
+ type: BitextMining
2299
+ - dataset:
2300
+ config: zul_Latn-hun_Latn
2301
+ name: MTEB NTREXBitextMining (zul_Latn-hun_Latn)
2302
+ revision: ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33
2303
+ split: test
2304
+ type: mteb/NTREX
2305
+ metrics:
2306
+ - type: accuracy
2307
+ value: 54.98247371056585
2308
+ - type: f1
2309
+ value: 48.79136275731169
2310
+ - type: main_score
2311
+ value: 48.79136275731169
2312
+ - type: precision
2313
+ value: 46.53637850035387
2314
+ - type: recall
2315
+ value: 54.98247371056585
2316
+ task:
2317
+ type: BitextMining
2318
+ - dataset:
2319
+ config: rom-hun
2320
+ name: MTEB RomaTalesBitextMining (rom-hun)
2321
+ revision: f4394dbca6845743cd33eba77431767b232ef489
2322
+ split: test
2323
+ type: kardosdrur/roma-tales
2324
+ metrics:
2325
+ - type: accuracy
2326
+ value: 10.69767441860465
2327
+ - type: f1
2328
+ value: 6.300343882963222
2329
+ - type: main_score
2330
+ value: 6.300343882963222
2331
+ - type: precision
2332
+ value: 5.2912513842746405
2333
+ - type: recall
2334
+ value: 10.69767441860465
2335
+ task:
2336
+ type: BitextMining
2337
+ - dataset:
2338
+ config: hun_Latn
2339
+ name: MTEB SIB200Classification (hun_Latn)
2340
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2341
+ split: test
2342
+ type: mteb/sib200
2343
+ metrics:
2344
+ - type: accuracy
2345
+ value: 70.7843137254902
2346
+ - type: f1
2347
+ value: 69.54715341688494
2348
+ - type: f1_weighted
2349
+ value: 70.80982490835149
2350
+ - type: main_score
2351
+ value: 70.7843137254902
2352
+ task:
2353
+ type: Classification
2354
+ - dataset:
2355
+ config: hun_Latn
2356
+ name: MTEB SIB200Classification (hun_Latn)
2357
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2358
+ split: train
2359
+ type: mteb/sib200
2360
+ metrics:
2361
+ - type: accuracy
2362
+ value: 71.04136947218261
2363
+ - type: f1
2364
+ value: 69.53067958950989
2365
+ - type: f1_weighted
2366
+ value: 71.08855534234819
2367
+ - type: main_score
2368
+ value: 71.04136947218261
2369
+ task:
2370
+ type: Classification
2371
+ - dataset:
2372
+ config: hun_Latn
2373
+ name: MTEB SIB200Classification (hun_Latn)
2374
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2375
+ split: validation
2376
+ type: mteb/sib200
2377
+ metrics:
2378
+ - type: accuracy
2379
+ value: 67.77777777777779
2380
+ - type: f1
2381
+ value: 65.81682696212664
2382
+ - type: f1_weighted
2383
+ value: 68.15630936254685
2384
+ - type: main_score
2385
+ value: 67.77777777777779
2386
+ task:
2387
+ type: Classification
2388
+ - dataset:
2389
+ config: hun_Latn
2390
+ name: MTEB SIB200ClusteringS2S (hun_Latn)
2391
+ revision: a74d7350ea12af010cfb1c21e34f1f81fd2e615b
2392
+ split: test
2393
+ type: mteb/sib200
2394
+ metrics:
2395
+ - type: main_score
2396
+ value: 37.555486757695725
2397
+ - type: v_measure
2398
+ value: 37.555486757695725
2399
+ - type: v_measure_std
2400
+ value: 5.704486435014278
2401
+ task:
2402
+ type: Clustering
2403
+ - dataset:
2404
+ config: hun-eng
2405
+ name: MTEB Tatoeba (hun-eng)
2406
+ revision: 69e8f12da6e31d59addadda9a9c8a2e601a0e282
2407
+ split: test
2408
+ type: mteb/tatoeba-bitext-mining
2409
+ metrics:
2410
+ - type: accuracy
2411
+ value: 80.9
2412
+ - type: f1
2413
+ value: 76.77888888888889
2414
+ - type: main_score
2415
+ value: 76.77888888888889
2416
+ - type: precision
2417
+ value: 74.9825
2418
+ - type: recall
2419
+ value: 80.9
2420
+ task:
2421
+ type: BitextMining
2422
+ tags:
2423
+ - mteb
2424
+ ---
2425
+
2426
  base_model: Alibaba-NLP/gte-multilingual-base
2427
  language:
2428
  - hu