tgsc commited on
Commit
4d4c18f
·
1 Parent(s): 88b47c5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -22,10 +22,11 @@ library_name: transformers
22
 
23
  ULT5-pt é um modelo de arquitetura T5-v1.1/google-ul2 treinado com o framework UL2 - [Unifying Language Learning Paradigms](https://arxiv.org/abs/2205.05131v1), que utiliza Mixture-of-Denoisers (MoD), o qual combina o objetivo de Causal Language Modeling (CLM) com Span Corruption.
24
 
25
- | Model | type | Parameters |
26
- | :-: | :-: | :-: |
27
- | [ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | encoder-decoder | 82.4M |
28
- | [sentence-transformer-ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | sentence-transformer | 51M |
 
29
 
30
 
31
  - **Developed by:** Thacio Garcia Scandaroli
 
22
 
23
  ULT5-pt é um modelo de arquitetura T5-v1.1/google-ul2 treinado com o framework UL2 - [Unifying Language Learning Paradigms](https://arxiv.org/abs/2205.05131v1), que utiliza Mixture-of-Denoisers (MoD), o qual combina o objetivo de Causal Language Modeling (CLM) com Span Corruption.
24
 
25
+ | Model | type | Vocabulary | Parameters | Context length |
26
+ | :-: | :-: | :-: | :-: | :-: |
27
+ | [ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | encoder-decoder | 65k |82.4M | 1024 |
28
+ | [sentence-transformer-ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | sentence-transformer | 65k | 51M | 1024 |
29
+ | [DeBERTina-base](https://huggingface.co/tgsc/debertina-base) | encoder | 32k | 100M | 512 |
30
 
31
 
32
  - **Developed by:** Thacio Garcia Scandaroli