maidalun1020
commited on
Commit
·
88bc9d1
1
Parent(s):
c0da3f5
Update README.md
Browse files
README.md
CHANGED
@@ -368,7 +368,16 @@ The summary of multiple domains evaluations can be seen in <a href=#1-multiple-d
|
|
368 |
|
369 |
#### 1. Multiple Domains Scenarios
|
370 |
|
371 |
-
<
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
372 |
|
373 |
***NOTE:***
|
374 |
- In `WithoutReranker` setting, our `bce-embedding-base_v1` outperforms all the other embedding models.
|
|
|
368 |
|
369 |
#### 1. Multiple Domains Scenarios
|
370 |
|
371 |
+
| Embedding Models | WithoutReranker <br> [*hit_rate/mrr*] | CohereRerank <br> [*hit_rate/mrr*] | bge-reranker-large <br> [*hit_rate/mrr*] | ***bce-reranker-base_v1*** <br> [*hit_rate/mrr*] |
|
372 |
+
|:-------------------------------|:--------:|:--------:|:--------:|:--------:|
|
373 |
+
| OpenAI-ada-2 | 81.04/57.35 | 88.35/67.83 | 88.89/69.64 | **90.71/75.46** |
|
374 |
+
| bge-large-en-v1.5 | 52.67/34.69 | 64.59/52.11 | 64.71/52.05 | **65.36/55.50** |
|
375 |
+
| bge-large-zh-v1.5 | 69.81/47.38 | 79.37/62.13 | 80.11/63.95 | **81.19/68.50** |
|
376 |
+
| llm-embedder | 50.85/33.26 | 63.62/51.45 | 63.54/51.32 | **64.47/54.98** |
|
377 |
+
| CohereV3-en | 53.10/35.39 | 65.75/52.80 | 66.29/53.31 | **66.91/56.93** |
|
378 |
+
| CohereV3-multilingual | 79.80/57.22 | 86.34/66.62 | 86.76/68.56 | **88.35/73.73** |
|
379 |
+
| JinaAI-v2-Base-en | 50.27/32.31 | 63.97/51.10 | 64.28/51.83 | **64.82/54.98** |
|
380 |
+
| ***bce-embedding-base_v1*** | **85.91/62.36** | **91.25/69.38** | **91.80/71.13** | ***93.46/77.02*** |
|
381 |
|
382 |
***NOTE:***
|
383 |
- In `WithoutReranker` setting, our `bce-embedding-base_v1` outperforms all the other embedding models.
|