Sentence Similarity
PEFT
yano0 commited on
Commit
a5bf60d
·
1 Parent(s): 52bb5f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -1,5 +1,7 @@
1
  ---
2
  library_name: peft
 
 
3
  ---
4
  These are LoRA adaption weights for [mT5](https://huggingface.co/google/mt5-xxl) encoder.
5
 
@@ -7,6 +9,9 @@ These are LoRA adaption weights for [mT5](https://huggingface.co/google/mt5-xxl)
7
  This model is a multilingual extension of Sentence T5 and was created using the [mT5](https://huggingface.co/google/mt5-xxl) encoder. It is proposed in this [paper](hoge).
8
  It is an encoder for sentence embedding, and its performance has been verified in cross-lingual STS and sentence retrieval.
9
 
 
 
 
10
  ### Framework versions
11
 
12
 
@@ -44,4 +49,4 @@ last_hidden_state = outputs.last_hidden_state
44
  last_hidden_state[inputs.attention_mask == 0, :] = 0
45
  sent_len = inputs.attention_mask.sum(dim=1, keepdim=True)
46
  sent_emb = last_hidden_state.sum(dim=1) / sent_len
47
- ```
 
1
  ---
2
  library_name: peft
3
+ datasets:
4
+ - xnli
5
  ---
6
  These are LoRA adaption weights for [mT5](https://huggingface.co/google/mt5-xxl) encoder.
7
 
 
9
  This model is a multilingual extension of Sentence T5 and was created using the [mT5](https://huggingface.co/google/mt5-xxl) encoder. It is proposed in this [paper](hoge).
10
  It is an encoder for sentence embedding, and its performance has been verified in cross-lingual STS and sentence retrieval.
11
 
12
+ ### Traning Data
13
+ The model was trained on the XNLI dataset.
14
+
15
  ### Framework versions
16
 
17
 
 
49
  last_hidden_state[inputs.attention_mask == 0, :] = 0
50
  sent_len = inputs.attention_mask.sum(dim=1, keepdim=True)
51
  sent_emb = last_hidden_state.sum(dim=1) / sent_len
52
+ ```