Commit
•
d9cfe58
1
Parent(s):
9b558b1
Adding eval results on mMARCO-fr (#1)
Browse files- Adding eval results on mMARCO-fr (bed99d0e1ddfb9472ba5b19602d25dd974462548)
Co-authored-by: Antoine Louis <[email protected]>
README.md
CHANGED
@@ -6,6 +6,36 @@ license: mit
|
|
6 |
language:
|
7 |
- fr
|
8 |
- en
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
---
|
10 |
|
11 |
# Solon Embeddings — Base 0.1
|
|
|
6 |
language:
|
7 |
- fr
|
8 |
- en
|
9 |
+
model-index:
|
10 |
+
- name: Solon-embeddings-base-0.1
|
11 |
+
results:
|
12 |
+
- task:
|
13 |
+
type: sentence-similarity
|
14 |
+
name: Passage Retrieval
|
15 |
+
dataset:
|
16 |
+
type: unicamp-dl/mmarco
|
17 |
+
name: mMARCO-fr
|
18 |
+
config: french
|
19 |
+
split: validation
|
20 |
+
metrics:
|
21 |
+
- type: recall_at_500
|
22 |
+
name: Recall@500
|
23 |
+
value: 90.9
|
24 |
+
- type: recall_at_100
|
25 |
+
name: Recall@100
|
26 |
+
value: 80.6
|
27 |
+
- type: recall_at_10
|
28 |
+
name: Recall@10
|
29 |
+
value: 52.5
|
30 |
+
- type: map_at_10
|
31 |
+
name: MAP@10
|
32 |
+
value: 27.4
|
33 |
+
- type: ndcg_at_10
|
34 |
+
name: nDCG@10
|
35 |
+
value: 33.5
|
36 |
+
- type: mrr_at_10
|
37 |
+
name: MRR@10
|
38 |
+
value: 27.9
|
39 |
---
|
40 |
|
41 |
# Solon Embeddings — Base 0.1
|