Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,23 @@ tags:
|
|
| 7 |
- transformers
|
| 8 |
---
|
| 9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
# kpf-sbert-v1
|
| 11 |
|
| 12 |
This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
|
|
|
|
| 7 |
- transformers
|
| 8 |
---
|
| 9 |
|
| 10 |
+
## Evaluation Results
|
| 11 |
+
|
| 12 |
+
- ์ฑ๋ฅ ์ธก์ ์ ์ํ ๋ง๋ญ์น๋, ์๋ ํ๊ตญ์ด (kor), ์์ด(en) ํ๊ฐ ๋ง๋ญ์น๋ฅผ ์ด์ฉํจ
|
| 13 |
+
<br> ํ๊ตญ์ด : **korsts(1,379์๋ฌธ์ฅ)** ์ **klue-sts(519์๋ฌธ์ฅ)**
|
| 14 |
+
<br> ์์ด : [stsb_multi_mt](https://huggingface.co/datasets/stsb_multi_mt)(1,376์๋ฌธ์ฅ) ์ [glue:stsb](https://huggingface.co/datasets/glue/viewer/stsb/validation) (1,500์๋ฌธ์ฅ)
|
| 15 |
+
- ์ฑ๋ฅ ์งํ๋ **cosin.spearman**
|
| 16 |
+
- ํ๊ฐ ์ธก์ ์ฝ๋๋ [์ฌ๊ธฐ](https://github.com/kobongsoo/BERT/blob/master/sbert/sbert-test3.ipynb) ์ฐธ์กฐ
|
| 17 |
+
-
|
| 18 |
+
|๋ชจ๋ธ |korsts|klue-sts|glue(stsb)|stsb_multi_mt(en)|
|
| 19 |
+
|:--------|------:|--------:|--------------:|------------:|
|
| 20 |
+
|distiluse-base-multilingual-cased-v2 |0.7475 |0.7855 |0.8193 |0.8075|
|
| 21 |
+
|paraphrase-multilingual-mpnet-base-v2 |0.8201 |0.7993 |0.8907 |0.8682|
|
| 22 |
+
|bongsoo/albert-small-kor-sbert-v1 |0.8305 |0.8588 |0.8419 |0.7965|
|
| 23 |
+
|bongsoo/kpf-sbert-v1.0 |0.8590 |0.8924 |0.8840 |0.8531|
|
| 24 |
+
|
| 25 |
+
For an automated evaluation of this model, see the *Sentence Embeddings Benchmark*: [https://seb.sbert.net](https://seb.sbert.net?model_name={MODEL_NAME})
|
| 26 |
+
|
| 27 |
# kpf-sbert-v1
|
| 28 |
|
| 29 |
This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
|