Update README.md
Browse files
README.md
CHANGED
|
@@ -23,10 +23,45 @@ This repository only contains the adapter of the fine-tuned model! You should ha
|
|
| 23 |
|
| 24 |
## Evaluation
|
| 25 |
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
---
|
| 32 |
|
|
|
|
| 23 |
|
| 24 |
## Evaluation
|
| 25 |
|
| 26 |
+
Benchmark Results on [MIRACL-ita-ArgosTranslate](https://huggingface.co/datasets/yuri-no/miracl-ita-argos) dev split
|
| 27 |
+
|
| 28 |
+
| **Model** | **MRR@10** | **Recall@100** | **nDCG@10** |
|
| 29 |
+
|:-------------:|:----------:|:--------------:|:-----------:|
|
| 30 |
+
| minerva-argos | 66.45 | 94.51 | 61.77 |
|
| 31 |
+
| minerva-palm | 65.32 | 94.38 | 60.74 |
|
| 32 |
+
| | | | |
|
| 33 |
+
| qwen-argos | 73.47 | 96.98 | 69.04 |
|
| 34 |
+
| qwen-palm | 73.16 | 97.21 | 69.12 |
|
| 35 |
+
| | | | |
|
| 36 |
+
| gemma-argos | 73.05 | 96.42 | 69.05 |
|
| 37 |
+
| gemma-palm | 72.56 | 96.33 | 68.87 |
|
| 38 |
+
|
| 39 |
+
Benchmark Results on [MIRACL-ita-PaLM](https://huggingface.co/datasets/yuri-no/miracl-ita-palm) dev split
|
| 40 |
+
|
| 41 |
+
| **Model** | **MRR@10** | **Recall@100** | **nDCG@10** |
|
| 42 |
+
|:-------------:|:----------:|:--------------:|:-----------:|
|
| 43 |
+
| minerva-argos | 67.93 | 96.39 | 64.04 |
|
| 44 |
+
| minerva-palm | 67.73 | 96.49 | 63.81 |
|
| 45 |
+
| | | | |
|
| 46 |
+
| qwen-argos | 74.95 | 97.96 | 71.29 |
|
| 47 |
+
| qwen-palm | 74.54 | 98.04 | 70.56 |
|
| 48 |
+
| | | | |
|
| 49 |
+
| gemma-argos | 75.80 | 98.43 | 71.95 |
|
| 50 |
+
| gemma-palm | 75.30 | 98.10 | 71.87 |
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
Benchmark Results on [Shitao/MLDR](https://huggingface.co/datasets/Shitao/MLDR) test split
|
| 54 |
+
|
| 55 |
+
| **Model** | **MRR@10** | **Recall@100** | **nDCG@10** |
|
| 56 |
+
|:-------------:|:----------:|:--------------:|:-----------:|
|
| 57 |
+
| minerva-argos | 36.04 | 67.50 | 38.75 |
|
| 58 |
+
| minerva-palm | 36.55 | 68.00 | 38.91 |
|
| 59 |
+
| | | | |
|
| 60 |
+
| qwen-argos | 40.19 | 70.50 | 42.68 |
|
| 61 |
+
| qwen-palm | 40.87 | 69.00 | 43.94 |
|
| 62 |
+
| | | | |
|
| 63 |
+
| gemma-argos | 37.19 | 75.00 | 39.78 |
|
| 64 |
+
| gemma-palm | 40.75 | 74.50 | 43.46 |
|
| 65 |
|
| 66 |
---
|
| 67 |
|