Update README.md
Browse files
README.md
CHANGED
@@ -10,16 +10,16 @@ T5 (Text-to-Text Transfer Transformer) model pretrained on Indonesian mC4 with [
|
|
10 |
|
11 |
## Pretraining Details
|
12 |
|
13 |
-
Trained for
|
14 |
-
|
15 |
-
## Limitations and bias
|
16 |
-
|
17 |
-
This model also has the problem of biased (unethical, harmful, biased) output results due to the bias of the content of the training data, which is associated with the language model using a large-scale corpus. There is potential. Assuming that this problem may occur, please be careful to use it only for applications that do not cause damage.
|
18 |
|
19 |
## Model Performance
|
20 |
|
21 |
TBD
|
22 |
|
|
|
|
|
|
|
|
|
23 |
## Acknowledgement
|
24 |
|
25 |
Thanks to Tensorflow Research Cloud for providing TPU v3-8s.
|
|
|
10 |
|
11 |
## Pretraining Details
|
12 |
|
13 |
+
Trained for 1M steps following [`google/t5-v1_1-small`](https://huggingface.co/google/t5-v1_1-small).
|
|
|
|
|
|
|
|
|
14 |
|
15 |
## Model Performance
|
16 |
|
17 |
TBD
|
18 |
|
19 |
+
## Limitations and bias
|
20 |
+
|
21 |
+
This model also has the problem of biased (unethical, harmful, biased) output results due to the bias of the content of the training data, which is associated with the language model using a large-scale corpus. There is potential. Assuming that this problem may occur, please be careful to use it only for applications that do not cause damage.
|
22 |
+
|
23 |
## Acknowledgement
|
24 |
|
25 |
Thanks to Tensorflow Research Cloud for providing TPU v3-8s.
|