maidalun1020 commited on
Commit
88bc9d1
·
1 Parent(s): c0da3f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -368,7 +368,16 @@ The summary of multiple domains evaluations can be seen in <a href=#1-multiple-d
368
 
369
  #### 1. Multiple Domains Scenarios
370
 
371
- <img src="https://github.com/netease-youdao/BCEmbedding/blob/master/Docs/assets/rag_eval_multiple_domains_summary.jpg">
 
 
 
 
 
 
 
 
 
372
 
373
  ***NOTE:***
374
  - In `WithoutReranker` setting, our `bce-embedding-base_v1` outperforms all the other embedding models.
 
368
 
369
  #### 1. Multiple Domains Scenarios
370
 
371
+ | Embedding Models | WithoutReranker <br> [*hit_rate/mrr*] | CohereRerank <br> [*hit_rate/mrr*] | bge-reranker-large <br> [*hit_rate/mrr*] | ***bce-reranker-base_v1*** <br> [*hit_rate/mrr*] |
372
+ |:-------------------------------|:--------:|:--------:|:--------:|:--------:|
373
+ | OpenAI-ada-2 | 81.04/57.35 | 88.35/67.83 | 88.89/69.64 | **90.71/75.46** |
374
+ | bge-large-en-v1.5 | 52.67/34.69 | 64.59/52.11 | 64.71/52.05 | **65.36/55.50** |
375
+ | bge-large-zh-v1.5 | 69.81/47.38 | 79.37/62.13 | 80.11/63.95 | **81.19/68.50** |
376
+ | llm-embedder | 50.85/33.26 | 63.62/51.45 | 63.54/51.32 | **64.47/54.98** |
377
+ | CohereV3-en | 53.10/35.39 | 65.75/52.80 | 66.29/53.31 | **66.91/56.93** |
378
+ | CohereV3-multilingual | 79.80/57.22 | 86.34/66.62 | 86.76/68.56 | **88.35/73.73** |
379
+ | JinaAI-v2-Base-en | 50.27/32.31 | 63.97/51.10 | 64.28/51.83 | **64.82/54.98** |
380
+ | ***bce-embedding-base_v1*** | **85.91/62.36** | **91.25/69.38** | **91.80/71.13** | ***93.46/77.02*** |
381
 
382
  ***NOTE:***
383
  - In `WithoutReranker` setting, our `bce-embedding-base_v1` outperforms all the other embedding models.