Update README.md
Browse files
README.md
CHANGED
@@ -22,10 +22,11 @@ library_name: transformers
|
|
22 |
|
23 |
ULT5-pt é um modelo de arquitetura T5-v1.1/google-ul2 treinado com o framework UL2 - [Unifying Language Learning Paradigms](https://arxiv.org/abs/2205.05131v1), que utiliza Mixture-of-Denoisers (MoD), o qual combina o objetivo de Causal Language Modeling (CLM) com Span Corruption.
|
24 |
|
25 |
-
| Model | type | Parameters |
|
26 |
-
| :-: | :-: |
|
27 |
-
| [ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | encoder-decoder | 82.4M |
|
28 |
-
| [sentence-transformer-ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small)
|
|
|
29 |
|
30 |
|
31 |
- **Developed by:** Thacio Garcia Scandaroli
|
|
|
22 |
|
23 |
ULT5-pt é um modelo de arquitetura T5-v1.1/google-ul2 treinado com o framework UL2 - [Unifying Language Learning Paradigms](https://arxiv.org/abs/2205.05131v1), que utiliza Mixture-of-Denoisers (MoD), o qual combina o objetivo de Causal Language Modeling (CLM) com Span Corruption.
|
24 |
|
25 |
+
| Model | type | Vocabulary | Parameters | Context length |
|
26 |
+
| :-: | :-: | :-: | :-: | :-: |
|
27 |
+
| [ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | encoder-decoder | 65k |82.4M | 1024 |
|
28 |
+
| [sentence-transformer-ult5-pt-small](https://huggingface.co/tgsc/ult5-pt-small) | sentence-transformer | 65k | 51M | 1024 |
|
29 |
+
| [DeBERTina-base](https://huggingface.co/tgsc/debertina-base) | encoder | 32k | 100M | 512 |
|
30 |
|
31 |
|
32 |
- **Developed by:** Thacio Garcia Scandaroli
|