NghiemAbe commited on
Commit
87fff89
·
verified ·
1 Parent(s): c42e9df

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -22
README.md CHANGED
@@ -6,7 +6,8 @@ tags:
6
  - feature-extraction
7
  - sentence-similarity
8
  - transformers
9
-
 
10
  ---
11
 
12
  # NghiemAbe/Vi-Legal-Bi-Encoder-v2
@@ -77,24 +78,14 @@ print(sentence_embeddings)
77
 
78
  ## Evaluation Results
79
 
80
- <!--- Describe how your model was evaluated -->
81
-
82
- For an automated evaluation of this model, see the *Sentence Embeddings Benchmark*: [https://seb.sbert.net](https://seb.sbert.net?model_name=NghiemAbe/Vi-Legal-Bi-Encoder-v2)
83
-
84
-
85
- ## Training
86
- The model was trained with the parameters:
87
-
88
-
89
-
90
- ## Full Model Architecture
91
- ```
92
- SentenceTransformer(
93
- (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: RobertaModel
94
- (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
95
- )
96
- ```
97
-
98
- ## Citing & Authors
99
-
100
- <!--- Describe where people can find more information -->
 
6
  - feature-extraction
7
  - sentence-similarity
8
  - transformers
9
+ language:
10
+ - vi
11
  ---
12
 
13
  # NghiemAbe/Vi-Legal-Bi-Encoder-v2
 
78
 
79
  ## Evaluation Results
80
 
81
+ I evaluated my [Dev-Legal-Dataset](https://huggingface.co/datasets/NghiemAbe/dev_legal) and here are the results:
82
+
83
+ | Model | R@1 | R@5 | R@10 | R@20 | R@100 | MRR@5 | MRR@10 | MRR@20 | MRR@100 | Avg |
84
+ |------------------------------------------------------------------------|------|------|------|------|-------|-------|--------|--------|---------|------|
85
+ | keepitreal/vietnamese-sbert | 0.278| 0.552| 0.649| 0.734| 0.842 | 0.396 | 0.409 | 0.415 | 0.417 | 0.521|
86
+ | sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | 0.314| 0.486| 0.585| 0.662| 0.854 | 0.395 | 0.409 | 0.414 | 0.419 | 0.504|
87
+ | sentence-transformers/paraphrase-multilingual-mpnet-base-v2 | 0.354| 0.553| 0.646| 0.750| 0.896 | 0.449 | 0.461 | 0.468 | 0.472 | 0.561|
88
+ | intfloat/multilingual-e5-small | 0.488| 0.746| 0.835| 0.906| 0.962 | 0.610 | 0.620 | 0.624 | 0.625 | 0.713|
89
+ | intfloat/multilingual-e5-base | 0.466| 0.740| 0.840| 0.907| 0.952 | 0.596 | 0.608 | 0.612 | 0.613 | 0.704|
90
+ | bkai-foundation-models/vietnamese-bi-encoder | 0.644| 0.881| 0.924| 0.954| 0.986 | 0.752 | 0.757 | 0.758 | 0.759 | 0.824|
91
+ | Vi-Legal-Bi-Encoder-v2 | 0.720| 0.884| 0.935| 0.963| 0.986 | 0.796 | 0.802 | 0.803 | 0.804 | 0.855|