huseinzol05
commited on
Commit
•
358fce1
1
Parent(s):
7345d48
Update README.md
Browse files
README.md
CHANGED
@@ -26,4 +26,15 @@ Preparing steps can reproduce at https://github.com/huseinzol05/malaya/tree/mast
|
|
26 |
## Pretraining details
|
27 |
|
28 |
- This model was trained using Google T5 repository https://github.com/google-research/text-to-text-transfer-transformer, on v3-8 TPU.
|
29 |
-
- All steps can reproduce from here, https://github.com/huseinzol05/Malaya/tree/master/pretrained-model/t5
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
## Pretraining details
|
27 |
|
28 |
- This model was trained using Google T5 repository https://github.com/google-research/text-to-text-transfer-transformer, on v3-8 TPU.
|
29 |
+
- All steps can reproduce from here, https://github.com/huseinzol05/Malaya/tree/master/pretrained-model/t5
|
30 |
+
|
31 |
+
## Supported prefix
|
32 |
+
|
33 |
+
1. `soalan: {string}`, trained using Natural QA.
|
34 |
+
2. `ringkasan: {string}`, for abstractive summarization.
|
35 |
+
3. `tajuk: {string}`, for abstractive title.
|
36 |
+
4. `parafrasa: {string}`, for abstractive paraphrase.
|
37 |
+
5. `terjemah Inggeris ke Melayu: {string}`, for EN-MS translation.
|
38 |
+
6. `terjemah Melayu ke Inggeris: {string}`, for MS-EN translation.
|
39 |
+
7. `grafik pengetahuan: {string}`, for MS text to EN Knowledge Graph triples format.
|
40 |
+
8. `ayat1: {string1} ayat2: {string2}`, semantic similarity.
|