Update README.md
Browse files
README.md
CHANGED
@@ -6,7 +6,8 @@ tags:
|
|
6 |
- feature-extraction
|
7 |
- sentence-similarity
|
8 |
- transformers
|
9 |
-
|
|
|
10 |
---
|
11 |
|
12 |
# NghiemAbe/Vi-Legal-Bi-Encoder-v2
|
@@ -77,24 +78,14 @@ print(sentence_embeddings)
|
|
77 |
|
78 |
## Evaluation Results
|
79 |
|
80 |
-
|
81 |
-
|
82 |
-
|
83 |
-
|
84 |
-
|
85 |
-
|
86 |
-
|
87 |
-
|
88 |
-
|
89 |
-
|
90 |
-
|
91 |
-
```
|
92 |
-
SentenceTransformer(
|
93 |
-
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: RobertaModel
|
94 |
-
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
|
95 |
-
)
|
96 |
-
```
|
97 |
-
|
98 |
-
## Citing & Authors
|
99 |
-
|
100 |
-
<!--- Describe where people can find more information -->
|
|
|
6 |
- feature-extraction
|
7 |
- sentence-similarity
|
8 |
- transformers
|
9 |
+
language:
|
10 |
+
- vi
|
11 |
---
|
12 |
|
13 |
# NghiemAbe/Vi-Legal-Bi-Encoder-v2
|
|
|
78 |
|
79 |
## Evaluation Results
|
80 |
|
81 |
+
I evaluated my [Dev-Legal-Dataset](https://huggingface.co/datasets/NghiemAbe/dev_legal) and here are the results:
|
82 |
+
|
83 |
+
| Model | R@1 | R@5 | R@10 | R@20 | R@100 | MRR@5 | MRR@10 | MRR@20 | MRR@100 | Avg |
|
84 |
+
|------------------------------------------------------------------------|------|------|------|------|-------|-------|--------|--------|---------|------|
|
85 |
+
| keepitreal/vietnamese-sbert | 0.278| 0.552| 0.649| 0.734| 0.842 | 0.396 | 0.409 | 0.415 | 0.417 | 0.521|
|
86 |
+
| sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | 0.314| 0.486| 0.585| 0.662| 0.854 | 0.395 | 0.409 | 0.414 | 0.419 | 0.504|
|
87 |
+
| sentence-transformers/paraphrase-multilingual-mpnet-base-v2 | 0.354| 0.553| 0.646| 0.750| 0.896 | 0.449 | 0.461 | 0.468 | 0.472 | 0.561|
|
88 |
+
| intfloat/multilingual-e5-small | 0.488| 0.746| 0.835| 0.906| 0.962 | 0.610 | 0.620 | 0.624 | 0.625 | 0.713|
|
89 |
+
| intfloat/multilingual-e5-base | 0.466| 0.740| 0.840| 0.907| 0.952 | 0.596 | 0.608 | 0.612 | 0.613 | 0.704|
|
90 |
+
| bkai-foundation-models/vietnamese-bi-encoder | 0.644| 0.881| 0.924| 0.954| 0.986 | 0.752 | 0.757 | 0.758 | 0.759 | 0.824|
|
91 |
+
| Vi-Legal-Bi-Encoder-v2 | 0.720| 0.884| 0.935| 0.963| 0.986 | 0.796 | 0.802 | 0.803 | 0.804 | 0.855|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|