Upload 12 files
Browse files- 1_Pooling/config.json +10 -0
- README.md +90 -1
- config.json +32 -0
- config_sentence_transformers.json +9 -0
- eval/Information-Retrieval_evaluation_results.csv +36 -0
- model.safetensors +3 -0
- modules.json +20 -0
- sentence_bert_config.json +4 -0
- special_tokens_map.json +37 -0
- tokenizer.json +0 -0
- tokenizer_config.json +57 -0
- vocab.txt +0 -0
1_Pooling/config.json
ADDED
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"word_embedding_dimension": 1024,
|
3 |
+
"pooling_mode_cls_token": true,
|
4 |
+
"pooling_mode_mean_tokens": false,
|
5 |
+
"pooling_mode_max_tokens": false,
|
6 |
+
"pooling_mode_mean_sqrt_len_tokens": false,
|
7 |
+
"pooling_mode_weightedmean_tokens": false,
|
8 |
+
"pooling_mode_lasttoken": false,
|
9 |
+
"include_prompt": true
|
10 |
+
}
|
README.md
CHANGED
@@ -1,3 +1,92 @@
|
|
1 |
---
|
2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
library_name: sentence-transformers
|
3 |
+
pipeline_tag: sentence-similarity
|
4 |
+
tags:
|
5 |
+
- sentence-transformers
|
6 |
+
- feature-extraction
|
7 |
+
- sentence-similarity
|
8 |
+
|
9 |
---
|
10 |
+
|
11 |
+
# {MODEL_NAME}
|
12 |
+
|
13 |
+
This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 1024 dimensional dense vector space and can be used for tasks like clustering or semantic search.
|
14 |
+
|
15 |
+
<!--- Describe your model here -->
|
16 |
+
|
17 |
+
## Usage (Sentence-Transformers)
|
18 |
+
|
19 |
+
Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
|
20 |
+
|
21 |
+
```
|
22 |
+
pip install -U sentence-transformers
|
23 |
+
```
|
24 |
+
|
25 |
+
Then you can use the model like this:
|
26 |
+
|
27 |
+
```python
|
28 |
+
from sentence_transformers import SentenceTransformer
|
29 |
+
sentences = ["This is an example sentence", "Each sentence is converted"]
|
30 |
+
|
31 |
+
model = SentenceTransformer('{MODEL_NAME}')
|
32 |
+
embeddings = model.encode(sentences)
|
33 |
+
print(embeddings)
|
34 |
+
```
|
35 |
+
|
36 |
+
|
37 |
+
|
38 |
+
## Evaluation Results
|
39 |
+
|
40 |
+
<!--- Describe how your model was evaluated -->
|
41 |
+
|
42 |
+
For an automated evaluation of this model, see the *Sentence Embeddings Benchmark*: [https://seb.sbert.net](https://seb.sbert.net?model_name={MODEL_NAME})
|
43 |
+
|
44 |
+
|
45 |
+
## Training
|
46 |
+
The model was trained with the parameters:
|
47 |
+
|
48 |
+
**DataLoader**:
|
49 |
+
|
50 |
+
`torch.utils.data.dataloader.DataLoader` of length 338 with parameters:
|
51 |
+
```
|
52 |
+
{'batch_size': 10, 'sampler': 'torch.utils.data.sampler.SequentialSampler', 'batch_sampler': 'torch.utils.data.sampler.BatchSampler'}
|
53 |
+
```
|
54 |
+
|
55 |
+
**Loss**:
|
56 |
+
|
57 |
+
`sentence_transformers.losses.MultipleNegativesRankingLoss.MultipleNegativesRankingLoss` with parameters:
|
58 |
+
```
|
59 |
+
{'scale': 20.0, 'similarity_fct': 'cos_sim'}
|
60 |
+
```
|
61 |
+
|
62 |
+
Parameters of the fit()-Method:
|
63 |
+
```
|
64 |
+
{
|
65 |
+
"epochs": 5,
|
66 |
+
"evaluation_steps": 50,
|
67 |
+
"evaluator": "sentence_transformers.evaluation.InformationRetrievalEvaluator.InformationRetrievalEvaluator",
|
68 |
+
"max_grad_norm": 1,
|
69 |
+
"optimizer_class": "<class 'torch.optim.adamw.AdamW'>",
|
70 |
+
"optimizer_params": {
|
71 |
+
"lr": 2e-05
|
72 |
+
},
|
73 |
+
"scheduler": "WarmupLinear",
|
74 |
+
"steps_per_epoch": null,
|
75 |
+
"warmup_steps": 169,
|
76 |
+
"weight_decay": 0.01
|
77 |
+
}
|
78 |
+
```
|
79 |
+
|
80 |
+
|
81 |
+
## Full Model Architecture
|
82 |
+
```
|
83 |
+
SentenceTransformer(
|
84 |
+
(0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel
|
85 |
+
(1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
|
86 |
+
(2): Normalize()
|
87 |
+
)
|
88 |
+
```
|
89 |
+
|
90 |
+
## Citing & Authors
|
91 |
+
|
92 |
+
<!--- Describe where people can find more information -->
|
config.json
ADDED
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"_name_or_path": "avsolatorio/GIST-large-Embedding-v0",
|
3 |
+
"architectures": [
|
4 |
+
"BertModel"
|
5 |
+
],
|
6 |
+
"attention_probs_dropout_prob": 0.1,
|
7 |
+
"classifier_dropout": null,
|
8 |
+
"gradient_checkpointing": false,
|
9 |
+
"hidden_act": "gelu",
|
10 |
+
"hidden_dropout_prob": 0.1,
|
11 |
+
"hidden_size": 1024,
|
12 |
+
"id2label": {
|
13 |
+
"0": "LABEL_0"
|
14 |
+
},
|
15 |
+
"initializer_range": 0.02,
|
16 |
+
"intermediate_size": 4096,
|
17 |
+
"label2id": {
|
18 |
+
"LABEL_0": 0
|
19 |
+
},
|
20 |
+
"layer_norm_eps": 1e-12,
|
21 |
+
"max_position_embeddings": 512,
|
22 |
+
"model_type": "bert",
|
23 |
+
"num_attention_heads": 16,
|
24 |
+
"num_hidden_layers": 24,
|
25 |
+
"pad_token_id": 0,
|
26 |
+
"position_embedding_type": "absolute",
|
27 |
+
"torch_dtype": "float32",
|
28 |
+
"transformers_version": "4.38.2",
|
29 |
+
"type_vocab_size": 2,
|
30 |
+
"use_cache": true,
|
31 |
+
"vocab_size": 30522
|
32 |
+
}
|
config_sentence_transformers.json
ADDED
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"__version__": {
|
3 |
+
"sentence_transformers": "2.2.2",
|
4 |
+
"transformers": "4.28.1",
|
5 |
+
"pytorch": "1.13.0+cu117"
|
6 |
+
},
|
7 |
+
"prompts": {},
|
8 |
+
"default_prompt_name": null
|
9 |
+
}
|
eval/Information-Retrieval_evaluation_results.csv
ADDED
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
epoch,steps,cos_sim-Accuracy@1,cos_sim-Accuracy@3,cos_sim-Accuracy@5,cos_sim-Accuracy@10,cos_sim-Precision@1,cos_sim-Recall@1,cos_sim-Precision@3,cos_sim-Recall@3,cos_sim-Precision@5,cos_sim-Recall@5,cos_sim-Precision@10,cos_sim-Recall@10,cos_sim-MRR@10,cos_sim-NDCG@10,cos_sim-MAP@100,dot_score-Accuracy@1,dot_score-Accuracy@3,dot_score-Accuracy@5,dot_score-Accuracy@10,dot_score-Precision@1,dot_score-Recall@1,dot_score-Precision@3,dot_score-Recall@3,dot_score-Precision@5,dot_score-Recall@5,dot_score-Precision@10,dot_score-Recall@10,dot_score-MRR@10,dot_score-NDCG@10,dot_score-MAP@100
|
2 |
+
0,50,0.27216715778194484,0.4186980980444683,0.4776319314224484,0.5521028663273506,0.27216715778194484,0.27216715778194484,0.13956603268148943,0.4186980980444683,0.09552638628448967,0.4776319314224484,0.05521028663273506,0.5521028663273506,0.36025399801853064,0.4062270766331196,0.3687583375801265,0.27216715778194484,0.4186980980444683,0.4776319314224484,0.5521028663273506,0.27216715778194484,0.27216715778194484,0.13956603268148943,0.4186980980444683,0.09552638628448967,0.4776319314224484,0.05521028663273506,0.5521028663273506,0.36025399801853064,0.4062270766331196,0.3687583375801265
|
3 |
+
0,100,0.2981516206804179,0.4385212965443343,0.4971872488615055,0.5687114920975087,0.2981516206804179,0.2981516206804179,0.1461737655147781,0.4385212965443343,0.09943744977230108,0.4971872488615055,0.056871149209750865,0.5687114920975087,0.383974759651159,0.42829499344257066,0.3924315087650031,0.2981516206804179,0.4385212965443343,0.4971872488615055,0.5687114920975087,0.2981516206804179,0.2981516206804179,0.1461737655147781,0.4385212965443343,0.09943744977230108,0.4971872488615055,0.056871149209750865,0.5687114920975087,0.383974759651159,0.42829499344257066,0.3924315087650031
|
4 |
+
0,150,0.2962764532547549,0.4436110366997053,0.4953120814358425,0.5679078489150817,0.2962764532547549,0.2962764532547549,0.14787034556656845,0.4436110366997053,0.09906241628716848,0.4953120814358425,0.05679078489150817,0.5679078489150817,0.38314974976507166,0.42750089896105525,0.3919289319897088,0.2962764532547549,0.4436110366997053,0.4953120814358425,0.5679078489150817,0.2962764532547549,0.2962764532547549,0.14787034556656845,0.4436110366997053,0.09906241628716848,0.4953120814358425,0.05679078489150817,0.5679078489150817,0.38314974976507166,0.42750089896105525,0.3919289319897088
|
5 |
+
0,200,0.28261451915349584,0.42539512456469325,0.48432895794267344,0.5654969193678007,0.28261451915349584,0.28261451915349584,0.14179837485489774,0.42539512456469325,0.0968657915885347,0.48432895794267344,0.05654969193678006,0.5654969193678007,0.370070138065048,0.4167471793926069,0.37854274603194477,0.28261451915349584,0.42539512456469325,0.48432895794267344,0.5654969193678007,0.28261451915349584,0.28261451915349584,0.14179837485489774,0.42539512456469325,0.0968657915885347,0.48432895794267344,0.05654969193678006,0.5654969193678007,0.370070138065048,0.4167471793926069,0.37854274603194477
|
6 |
+
0,250,0.29145459416019287,0.4401285829091883,0.5046879185641575,0.5772836860433967,0.29145459416019287,0.29145459416019287,0.1467095276363961,0.4401285829091883,0.10093758371283149,0.5046879185641575,0.05772836860433967,0.5772836860433967,0.3825378754055416,0.42928815642573587,0.390733853312954,0.29145459416019287,0.4401285829091883,0.5046879185641575,0.5772836860433967,0.29145459416019287,0.29145459416019287,0.1467095276363961,0.4401285829091883,0.10093758371283149,0.5046879185641575,0.05772836860433967,0.5772836860433967,0.3825378754055416,0.42928815642573587,0.390733853312954
|
7 |
+
0,300,0.3024377176533619,0.44173586927404235,0.5009375837128315,0.5756763996785427,0.3024377176533619,0.3024377176533619,0.1472452897580141,0.44173586927404235,0.1001875167425663,0.5009375837128315,0.057567639967854266,0.5756763996785427,0.38669981163284073,0.4318825777736291,0.3950275595255035,0.3024377176533619,0.44173586927404235,0.5009375837128315,0.5756763996785427,0.3024377176533619,0.3024377176533619,0.1472452897580141,0.44173586927404235,0.1001875167425663,0.5009375837128315,0.057567639967854266,0.5756763996785427,0.38669981163284073,0.4318825777736291,0.3950275595255035
|
8 |
+
0,-1,0.2935976426466649,0.4412001071524243,0.49182962764532545,0.5665684436110368,0.2935976426466649,0.2935976426466649,0.14706670238414143,0.4412001071524243,0.09836592552906508,0.49182962764532545,0.056656844361103666,0.5665684436110368,0.38049793986707925,0.4251101571507351,0.3890892519374965,0.2935976426466649,0.4412001071524243,0.49182962764532545,0.5665684436110368,0.2935976426466649,0.2935976426466649,0.14706670238414143,0.4412001071524243,0.09836592552906508,0.49182962764532545,0.056656844361103666,0.5665684436110368,0.38049793986707925,0.4251101571507351,0.3890892519374965
|
9 |
+
1,50,0.2970800964371819,0.43932493972676134,0.49638360567907847,0.5711224216447898,0.2970800964371819,0.2970800964371819,0.1464416465755871,0.43932493972676134,0.0992767211358157,0.49638360567907847,0.057112242164478966,0.5711224216447898,0.3827237976179838,0.4278313372375963,0.3910608869415961,0.2970800964371819,0.43932493972676134,0.49638360567907847,0.5711224216447898,0.2970800964371819,0.2970800964371819,0.1464416465755871,0.43932493972676134,0.0992767211358157,0.49638360567907847,0.057112242164478966,0.5711224216447898,0.3827237976179838,0.4278313372375963,0.3910608869415961
|
10 |
+
1,100,0.30699169568711493,0.4409322260916153,0.4929011518885615,0.5681757299758907,0.30699169568711493,0.30699169568711493,0.1469774086972051,0.4409322260916153,0.0985802303777123,0.4929011518885615,0.05681757299758907,0.5681757299758907,0.3886277048545996,0.431566859074581,0.39705699645189046,0.30699169568711493,0.4409322260916153,0.4929011518885615,0.5681757299758907,0.30699169568711493,0.30699169568711493,0.1469774086972051,0.4409322260916153,0.0985802303777123,0.4929011518885615,0.05681757299758907,0.5681757299758907,0.3886277048545996,0.431566859074581,0.39705699645189046
|
11 |
+
1,150,0.31315296008572197,0.45245111170640234,0.5049557996249665,0.5695151352799357,0.31315296008572197,0.31315296008572197,0.15081703723546747,0.45245111170640234,0.1009911599249933,0.5049557996249665,0.05695151352799356,0.5695151352799357,0.39589015175674613,0.43762509242769426,0.4044754034699578,0.31315296008572197,0.45245111170640234,0.5049557996249665,0.5695151352799357,0.31315296008572197,0.31315296008572197,0.15081703723546747,0.45245111170640234,0.1009911599249933,0.5049557996249665,0.05695151352799356,0.5695151352799357,0.39589015175674613,0.43762509242769426,0.4044754034699578
|
12 |
+
1,200,0.3029734797749799,0.44682560942941335,0.5004018215912135,0.5689793731583177,0.3029734797749799,0.3029734797749799,0.14894186980980445,0.44682560942941335,0.1000803643182427,0.5004018215912135,0.056897937315831766,0.5689793731583177,0.3881614642463825,0.43154273653421776,0.3963571036783746,0.3029734797749799,0.44682560942941335,0.5004018215912135,0.5689793731583177,0.3029734797749799,0.3029734797749799,0.14894186980980445,0.44682560942941335,0.1000803643182427,0.5004018215912135,0.056897937315831766,0.5689793731583177,0.3881614642463825,0.43154273653421776,0.3963571036783746
|
13 |
+
1,250,0.29225823734261985,0.4401285829091883,0.4969193678006965,0.5679078489150817,0.29225823734261985,0.29225823734261985,0.1467095276363961,0.4401285829091883,0.0993838735601393,0.4969193678006965,0.05679078489150816,0.5679078489150817,0.38005519200268656,0.42517120683923765,0.3881728882263625,0.29225823734261985,0.4401285829091883,0.4969193678006965,0.5679078489150817,0.29225823734261985,0.29225823734261985,0.1467095276363961,0.4401285829091883,0.0993838735601393,0.4969193678006965,0.05679078489150816,0.5679078489150817,0.38005519200268656,0.42517120683923765,0.3881728882263625
|
14 |
+
1,300,0.2973479774979909,0.44200375033485134,0.49397267613179746,0.5633538708813287,0.2973479774979909,0.2973479774979909,0.14733458344495043,0.44200375033485134,0.09879453522635949,0.49397267613179746,0.05633538708813286,0.5633538708813287,0.3826594849029882,0.42607855708082354,0.3913114627118647,0.2973479774979909,0.44200375033485134,0.49397267613179746,0.5633538708813287,0.2973479774979909,0.2973479774979909,0.14733458344495043,0.44200375033485134,0.09879453522635949,0.49397267613179746,0.05633538708813286,0.5633538708813287,0.3826594849029882,0.42607855708082354,0.3913114627118647
|
15 |
+
1,-1,0.2978837396196089,0.43959282078757034,0.4896865791588535,0.5644253951245647,0.2978837396196089,0.2978837396196089,0.14653094026252345,0.43959282078757034,0.0979373158317707,0.4896865791588535,0.056442539512456466,0.5644253951245647,0.3817196688479835,0.4255103345448132,0.3900974205511569,0.2978837396196089,0.43959282078757034,0.4896865791588535,0.5644253951245647,0.2978837396196089,0.2978837396196089,0.14653094026252345,0.43959282078757034,0.0979373158317707,0.4896865791588535,0.056442539512456466,0.5644253951245647,0.3817196688479835,0.4255103345448132,0.3900974205511569
|
16 |
+
2,50,0.29440128582909186,0.4334315563889633,0.4878114117331905,0.5558532011786766,0.29440128582909186,0.29440128582909186,0.14447718546298774,0.4334315563889633,0.0975622823466381,0.4878114117331905,0.05558532011786767,0.5558532011786766,0.3768972782433802,0.4198367715676712,0.3855750356234196,0.29440128582909186,0.4334315563889633,0.4878114117331905,0.5558532011786766,0.29440128582909186,0.29440128582909186,0.14447718546298774,0.4334315563889633,0.0975622823466381,0.4878114117331905,0.05558532011786767,0.5558532011786766,0.3768972782433802,0.4198367715676712,0.3855750356234196
|
17 |
+
2,100,0.29681221537637287,0.4366461291186713,0.48834717385480847,0.5601392981516207,0.29681221537637287,0.29681221537637287,0.14554870970622374,0.4366461291186713,0.09766943477096168,0.48834717385480847,0.05601392981516206,0.5601392981516207,0.37996430378562635,0.42314500835145685,0.3886914582931016,0.29681221537637287,0.4366461291186713,0.48834717385480847,0.5601392981516207,0.29681221537637287,0.29681221537637287,0.14554870970622374,0.4366461291186713,0.09766943477096168,0.48834717385480847,0.05601392981516206,0.5601392981516207,0.37996430378562635,0.42314500835145685,0.3886914582931016
|
18 |
+
2,150,0.3021698365925529,0.4377176533619073,0.4929011518885615,0.5633538708813287,0.3021698365925529,0.3021698365925529,0.1459058844539691,0.4377176533619073,0.0985802303777123,0.4929011518885615,0.05633538708813286,0.5633538708813287,0.383584312374829,0.42659731661351546,0.39206582051188693,0.3021698365925529,0.4377176533619073,0.4929011518885615,0.5633538708813287,0.3021698365925529,0.3021698365925529,0.1459058844539691,0.4377176533619073,0.0985802303777123,0.4929011518885615,0.05633538708813286,0.5633538708813287,0.383584312374829,0.42659731661351546,0.39206582051188693
|
19 |
+
2,200,0.29922314492365387,0.4401285829091883,0.49156174658451646,0.5614787034556656,0.29922314492365387,0.29922314492365387,0.1467095276363961,0.4401285829091883,0.09831234931690329,0.49156174658451646,0.056147870345566564,0.5614787034556656,0.382135203398262,0.425145784378718,0.3905640534235459,0.29922314492365387,0.4401285829091883,0.49156174658451646,0.5614787034556656,0.29922314492365387,0.29922314492365387,0.1467095276363961,0.4401285829091883,0.09831234931690329,0.49156174658451646,0.056147870345566564,0.5614787034556656,0.382135203398262,0.425145784378718,0.3905640534235459
|
20 |
+
2,250,0.2954728100723279,0.43477096169300833,0.4904902223412805,0.5614787034556656,0.2954728100723279,0.2954728100723279,0.14492365389766942,0.43477096169300833,0.09809804446825608,0.4904902223412805,0.05614787034556656,0.5614787034556656,0.37874055506656573,0.4225246974034418,0.387262048165291,0.2954728100723279,0.43477096169300833,0.4904902223412805,0.5614787034556656,0.2954728100723279,0.2954728100723279,0.14492365389766942,0.43477096169300833,0.09809804446825608,0.4904902223412805,0.05614787034556656,0.5614787034556656,0.37874055506656573,0.4225246974034418,0.387262048165291
|
21 |
+
2,300,0.2960085721939459,0.4315563889633003,0.48700776855076344,0.5604071792124297,0.2960085721939459,0.2960085721939459,0.14385212965443342,0.4315563889633003,0.09740155371015269,0.48700776855076344,0.05604071792124297,0.5604071792124297,0.3782726136262158,0.42186444236910514,0.3869680133273024,0.2960085721939459,0.4315563889633003,0.48700776855076344,0.5604071792124297,0.2960085721939459,0.2960085721939459,0.14385212965443342,0.4315563889633003,0.09740155371015269,0.48700776855076344,0.05604071792124297,0.5604071792124297,0.3782726136262158,0.42186444236910514,0.3869680133273024
|
22 |
+
2,-1,0.2938655237074739,0.4310206268416823,0.48459683900348244,0.5566568443611036,0.2938655237074739,0.2938655237074739,0.14367354228056076,0.4310206268416823,0.09691936780069647,0.48459683900348244,0.05566568443611036,0.5566568443611036,0.3766561852886516,0.4197757722994446,0.3854031922774534,0.2938655237074739,0.4310206268416823,0.48459683900348244,0.5566568443611036,0.2938655237074739,0.2938655237074739,0.14367354228056076,0.4310206268416823,0.09691936780069647,0.48459683900348244,0.05566568443611036,0.5566568443611036,0.3766561852886516,0.4197757722994446,0.38540313518430314
|
23 |
+
3,50,0.2930618805250469,0.4326279132065363,0.48834717385480847,0.5585320117867667,0.2930618805250469,0.2930618805250469,0.14420930440217875,0.4326279132065363,0.0976694347709617,0.48834717385480847,0.05585320117867667,0.5585320117867667,0.37649035415577004,0.42011734178768007,0.38513874845084406,0.2930618805250469,0.4326279132065363,0.48834717385480847,0.5585320117867667,0.2930618805250469,0.2930618805250469,0.14420930440217875,0.4326279132065363,0.0976694347709617,0.48834717385480847,0.05585320117867667,0.5585320117867667,0.37649035415577004,0.42011734178768007,0.38513874845084406
|
24 |
+
3,100,0.2911867130993839,0.4336994374497723,0.4878114117331905,0.5625502276989017,0.2911867130993839,0.2911867130993839,0.1445664791499241,0.4336994374497723,0.09756228234663808,0.4878114117331905,0.05625502276989016,0.5625502276989017,0.37587518443398354,0.4205406351167441,0.384436813681462,0.2911867130993839,0.4336994374497723,0.4878114117331905,0.5625502276989017,0.2911867130993839,0.2911867130993839,0.1445664791499241,0.4336994374497723,0.09756228234663808,0.4878114117331905,0.05625502276989016,0.5625502276989017,0.37587518443398354,0.4205406351167441,0.384436813681462
|
25 |
+
3,150,0.28690061612643986,0.4315563889633003,0.4854004821859095,0.5587998928475757,0.28690061612643986,0.28690061612643986,0.14385212965443342,0.4315563889633003,0.09708009643718188,0.4854004821859095,0.055879989284757556,0.5587998928475757,0.37324601686374986,0.4177476910436912,0.38194374456880226,0.28690061612643986,0.4315563889633003,0.4854004821859095,0.5587998928475757,0.28690061612643986,0.28690061612643986,0.14385212965443342,0.4315563889633003,0.09708009643718188,0.4854004821859095,0.055879989284757556,0.5587998928475757,0.37324601686374986,0.4177476910436912,0.38194374456880226
|
26 |
+
3,200,0.2933297615858559,0.4318242700241093,0.4899544602196625,0.5620144655772837,0.2933297615858559,0.2933297615858559,0.14394142334136975,0.4318242700241093,0.09799089204393248,0.4899544602196625,0.056201446557728366,0.5620144655772837,0.37702494695529737,0.4212710121248832,0.38544571181034165,0.2933297615858559,0.4318242700241093,0.4899544602196625,0.5620144655772837,0.2933297615858559,0.2933297615858559,0.14394142334136975,0.4318242700241093,0.09799089204393248,0.4899544602196625,0.056201446557728366,0.5620144655772837,0.37702494695529737,0.4212710121248832,0.38544571181034165
|
27 |
+
3,250,0.2903830699169569,0.4283418162335923,0.48486472006429143,0.5566568443611036,0.2903830699169569,0.2903830699169569,0.14278060541119744,0.4283418162335923,0.09697294401285829,0.48486472006429143,0.05566568443611037,0.5566568443611036,0.3738071851653414,0.4176171902990066,0.38245480451565905,0.2903830699169569,0.4283418162335923,0.48486472006429143,0.5566568443611036,0.2903830699169569,0.2903830699169569,0.14278060541119744,0.4283418162335923,0.09697294401285829,0.48486472006429143,0.05566568443611037,0.5566568443611036,0.3738071851653414,0.4176171902990066,0.38245480451565905
|
28 |
+
3,300,0.28770425930886684,0.42700241092954727,0.48459683900348244,0.5526386284489686,0.28770425930886684,0.28770425930886684,0.14233413697651576,0.42700241092954727,0.09691936780069647,0.48459683900348244,0.055263862844896865,0.5526386284489686,0.3716337343045081,0.4150672114403791,0.3805376860590383,0.28770425930886684,0.42700241092954727,0.48459683900348244,0.5526386284489686,0.28770425930886684,0.28770425930886684,0.14233413697651576,0.42700241092954727,0.09691936780069647,0.48459683900348244,0.055263862844896865,0.5526386284489686,0.3716337343045081,0.4150672114403791,0.3805376860590383
|
29 |
+
3,-1,0.28770425930886684,0.4259308866863113,0.48111438521296546,0.5539780337530137,0.28770425930886684,0.28770425930886684,0.14197696222877043,0.4259308866863113,0.09622287704259307,0.48111438521296546,0.05539780337530136,0.5539780337530137,0.37104886065507525,0.41485233319714304,0.37976560549588034,0.28770425930886684,0.4259308866863113,0.48111438521296546,0.5539780337530137,0.28770425930886684,0.28770425930886684,0.14197696222877043,0.4259308866863113,0.09622287704259307,0.48111438521296546,0.05539780337530136,0.5539780337530137,0.37104886065507525,0.41485233319714304,0.37976560549588034
|
30 |
+
4,50,0.28716849718724885,0.4261987677471203,0.48138226627377445,0.5534422716313957,0.28716849718724885,0.28716849718724885,0.14206625591570674,0.4261987677471203,0.09627645325475488,0.48138226627377445,0.05534422716313956,0.5534422716313957,0.37088079718002015,0.41463617370329997,0.37959753976480404,0.28716849718724885,0.4261987677471203,0.48138226627377445,0.5534422716313957,0.28716849718724885,0.28716849718724885,0.14206625591570674,0.4261987677471203,0.09627645325475488,0.48138226627377445,0.05534422716313956,0.5534422716313957,0.37088079718002015,0.41463617370329997,0.37959753976480404
|
31 |
+
4,100,0.2860969729440129,0.42512724350388426,0.48057862309134747,0.5529065095097777,0.2860969729440129,0.2860969729440129,0.14170908116796144,0.42512724350388426,0.09611572461826948,0.48057862309134747,0.055290650950977765,0.5529065095097777,0.36983808078102187,0.4137141027783545,0.37861788084290465,0.2860969729440129,0.42512724350388426,0.48057862309134747,0.5529065095097777,0.2860969729440129,0.2860969729440129,0.14170908116796144,0.42512724350388426,0.09611572461826948,0.48057862309134747,0.055290650950977765,0.5529065095097777,0.36983808078102187,0.4137141027783545,0.37861788084290465
|
32 |
+
4,150,0.28502544870077684,0.4264666488079293,0.4800428609697294,0.5547816769354407,0.28502544870077684,0.28502544870077684,0.1421555496026431,0.4264666488079293,0.09600857219394589,0.4800428609697294,0.05547816769354406,0.5547816769354407,0.3696487569043149,0.41400590346805183,0.37832420386942117,0.28502544870077684,0.4264666488079293,0.4800428609697294,0.5547816769354407,0.28502544870077684,0.28502544870077684,0.1421555496026431,0.4264666488079293,0.09600857219394589,0.4800428609697294,0.05547816769354406,0.5547816769354407,0.3696487569043149,0.41400590346805183,0.37832420386942117
|
33 |
+
4,200,0.28368604339673187,0.4264666488079293,0.48191802839539244,0.5534422716313957,0.28368604339673187,0.28368604339673187,0.1421555496026431,0.4264666488079293,0.09638360567907847,0.48191802839539244,0.05534422716313956,0.5534422716313957,0.36894865187793097,0.41318465952543887,0.37769214793751493,0.28368604339673187,0.4264666488079293,0.48191802839539244,0.5534422716313957,0.28368604339673187,0.28368604339673187,0.1421555496026431,0.4264666488079293,0.09638360567907847,0.48191802839539244,0.05534422716313956,0.5534422716313957,0.36894865187793097,0.41318465952543887,0.37769214793751493
|
34 |
+
4,250,0.2831502812751138,0.4261987677471203,0.48138226627377445,0.5542459148138227,0.2831502812751138,0.2831502812751138,0.14206625591570674,0.4261987677471203,0.09627645325475488,0.48138226627377445,0.05542459148138226,0.5542459148138227,0.36845668618371497,0.41297139303451713,0.37714372529987095,0.2831502812751138,0.4261987677471203,0.48138226627377445,0.5542459148138227,0.2831502812751138,0.2831502812751138,0.14206625591570674,0.4261987677471203,0.09627645325475488,0.48138226627377445,0.05542459148138226,0.5542459148138227,0.36845668618371497,0.41297139303451713,0.37714372529987095
|
35 |
+
4,300,0.2831502812751138,0.42539512456469325,0.4776319314224484,0.5542459148138227,0.2831502812751138,0.2831502812751138,0.14179837485489774,0.42539512456469325,0.09552638628448967,0.4776319314224484,0.05542459148138226,0.5542459148138227,0.3682456766973237,0.4127774987866691,0.3768811043805591,0.2831502812751138,0.42539512456469325,0.4776319314224484,0.5542459148138227,0.2831502812751138,0.2831502812751138,0.14179837485489774,0.42539512456469325,0.09552638628448967,0.4776319314224484,0.05542459148138226,0.5542459148138227,0.3682456766973237,0.4127774987866691,0.3768811043805591
|
36 |
+
4,-1,0.28422180551834986,0.42539512456469325,0.47843557460487546,0.5542459148138227,0.28422180551834986,0.28422180551834986,0.14179837485489774,0.42539512456469325,0.09568711492097506,0.47843557460487546,0.05542459148138226,0.5542459148138227,0.3687952580800151,0.4131879766758827,0.3774190349432726,0.28422180551834986,0.42539512456469325,0.47843557460487546,0.5542459148138227,0.28422180551834986,0.28422180551834986,0.14179837485489774,0.42539512456469325,0.09568711492097506,0.47843557460487546,0.05542459148138226,0.5542459148138227,0.3687952580800151,0.4131879766758827,0.3774190349432726
|
model.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:81b749de77f4ad470acf4b06b35ea1669e47cf881289d9607a94f83bd074b399
|
3 |
+
size 1340612432
|
modules.json
ADDED
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
[
|
2 |
+
{
|
3 |
+
"idx": 0,
|
4 |
+
"name": "0",
|
5 |
+
"path": "",
|
6 |
+
"type": "sentence_transformers.models.Transformer"
|
7 |
+
},
|
8 |
+
{
|
9 |
+
"idx": 1,
|
10 |
+
"name": "1",
|
11 |
+
"path": "1_Pooling",
|
12 |
+
"type": "sentence_transformers.models.Pooling"
|
13 |
+
},
|
14 |
+
{
|
15 |
+
"idx": 2,
|
16 |
+
"name": "2",
|
17 |
+
"path": "2_Normalize",
|
18 |
+
"type": "sentence_transformers.models.Normalize"
|
19 |
+
}
|
20 |
+
]
|
sentence_bert_config.json
ADDED
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"max_seq_length": 512,
|
3 |
+
"do_lower_case": true
|
4 |
+
}
|
special_tokens_map.json
ADDED
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"cls_token": {
|
3 |
+
"content": "[CLS]",
|
4 |
+
"lstrip": false,
|
5 |
+
"normalized": false,
|
6 |
+
"rstrip": false,
|
7 |
+
"single_word": false
|
8 |
+
},
|
9 |
+
"mask_token": {
|
10 |
+
"content": "[MASK]",
|
11 |
+
"lstrip": false,
|
12 |
+
"normalized": false,
|
13 |
+
"rstrip": false,
|
14 |
+
"single_word": false
|
15 |
+
},
|
16 |
+
"pad_token": {
|
17 |
+
"content": "[PAD]",
|
18 |
+
"lstrip": false,
|
19 |
+
"normalized": false,
|
20 |
+
"rstrip": false,
|
21 |
+
"single_word": false
|
22 |
+
},
|
23 |
+
"sep_token": {
|
24 |
+
"content": "[SEP]",
|
25 |
+
"lstrip": false,
|
26 |
+
"normalized": false,
|
27 |
+
"rstrip": false,
|
28 |
+
"single_word": false
|
29 |
+
},
|
30 |
+
"unk_token": {
|
31 |
+
"content": "[UNK]",
|
32 |
+
"lstrip": false,
|
33 |
+
"normalized": false,
|
34 |
+
"rstrip": false,
|
35 |
+
"single_word": false
|
36 |
+
}
|
37 |
+
}
|
tokenizer.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
tokenizer_config.json
ADDED
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"added_tokens_decoder": {
|
3 |
+
"0": {
|
4 |
+
"content": "[PAD]",
|
5 |
+
"lstrip": false,
|
6 |
+
"normalized": false,
|
7 |
+
"rstrip": false,
|
8 |
+
"single_word": false,
|
9 |
+
"special": true
|
10 |
+
},
|
11 |
+
"100": {
|
12 |
+
"content": "[UNK]",
|
13 |
+
"lstrip": false,
|
14 |
+
"normalized": false,
|
15 |
+
"rstrip": false,
|
16 |
+
"single_word": false,
|
17 |
+
"special": true
|
18 |
+
},
|
19 |
+
"101": {
|
20 |
+
"content": "[CLS]",
|
21 |
+
"lstrip": false,
|
22 |
+
"normalized": false,
|
23 |
+
"rstrip": false,
|
24 |
+
"single_word": false,
|
25 |
+
"special": true
|
26 |
+
},
|
27 |
+
"102": {
|
28 |
+
"content": "[SEP]",
|
29 |
+
"lstrip": false,
|
30 |
+
"normalized": false,
|
31 |
+
"rstrip": false,
|
32 |
+
"single_word": false,
|
33 |
+
"special": true
|
34 |
+
},
|
35 |
+
"103": {
|
36 |
+
"content": "[MASK]",
|
37 |
+
"lstrip": false,
|
38 |
+
"normalized": false,
|
39 |
+
"rstrip": false,
|
40 |
+
"single_word": false,
|
41 |
+
"special": true
|
42 |
+
}
|
43 |
+
},
|
44 |
+
"clean_up_tokenization_spaces": true,
|
45 |
+
"cls_token": "[CLS]",
|
46 |
+
"do_basic_tokenize": true,
|
47 |
+
"do_lower_case": true,
|
48 |
+
"mask_token": "[MASK]",
|
49 |
+
"model_max_length": 512,
|
50 |
+
"never_split": null,
|
51 |
+
"pad_token": "[PAD]",
|
52 |
+
"sep_token": "[SEP]",
|
53 |
+
"strip_accents": null,
|
54 |
+
"tokenize_chinese_chars": true,
|
55 |
+
"tokenizer_class": "BertTokenizer",
|
56 |
+
"unk_token": "[UNK]"
|
57 |
+
}
|
vocab.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|