Divyasreepat commited on
Commit
9cc3684
·
verified ·
1 Parent(s): eabdf44

Update README.md with new model card content

Browse files
Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -15,7 +15,7 @@ T5 encoder-decoder backbone model.
15
  T5 is a LLM pretrained on a mix of unsupervised and supervised tasks,
16
  where each task is converted to a sequence-to-sequence format.
17
  T5 works well on a variety of tasks out-of-the-box by prepending
18
- various prefixex to the input sequence, e.g., for translation:
19
  `"translate English to German: ..."`, for summarization:
20
  `"summarize: ..."`.
21
 
@@ -29,6 +29,41 @@ preset architectures and weights, use the `from_preset` constructor.
29
  Disclaimer: Pre-trained models are provided on an "as is" basis, without
30
  warranties or conditions of any kind.
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
  __Arguments__
34
 
 
15
  T5 is a LLM pretrained on a mix of unsupervised and supervised tasks,
16
  where each task is converted to a sequence-to-sequence format.
17
  T5 works well on a variety of tasks out-of-the-box by prepending
18
+ various prefixes to the input sequence, e.g., for translation:
19
  `"translate English to German: ..."`, for summarization:
20
  `"summarize: ..."`.
21
 
 
29
  Disclaimer: Pre-trained models are provided on an "as is" basis, without
30
  warranties or conditions of any kind.
31
 
32
+ ## Links
33
+
34
+ * [T5 Quickstart Notebook](coming soon)
35
+ * [T5 API Documentation](https://keras.io/keras_hub/api/models/t5/)
36
+ * [T5 Model Card](https://github.com/google-research/text-to-text-transfer-transformer/tree/main)
37
+ * [KerasHub Beginner Guide](https://keras.io/guides/keras_hub/getting_started/)
38
+ * [KerasHub Model Publishing Guide](https://keras.io/guides/keras_hub/upload/)
39
+
40
+ ## Installation
41
+
42
+ Keras and KerasHub can be installed with:
43
+
44
+ ```
45
+ pip install -U -q keras-hub
46
+ pip install -U -q keras
47
+ ```
48
+
49
+ Jax, TensorFlow, and Torch come preinstalled in Kaggle Notebooks. For instructions on installing them in another environment see the [Keras Getting Started](https://keras.io/getting_started/) page.
50
+
51
+ ## Presets
52
+
53
+ The following model checkpoints are provided by the Keras team. Full code examples for each are available below.
54
+ | Preset name | Parameters | Description |
55
+ |----------------|------------|--------------------------------------------------|
56
+ | t5_small_multi | 0 | 8-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4).|
57
+ | t5_base_multi| 0 | 12-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4). |
58
+ | t5_large_multi | 0 | 24-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4). |
59
+ | flan_small_multi | 0 | 8-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4). |
60
+ | flan_base_multi | 0 | 12-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4). |
61
+ | flan_large_multi | 0 | 24-layer T5 model. Trained on the Colossal Clean Crawled Corpus (C4). |
62
+ | t5_1.1_small | 60.51M | |
63
+ | tt5_1.1_base | 247.58M | |
64
+ | t5_1.1_large | 750.25M | |
65
+ | t5_1.1_xl | 2.85B | |
66
+ | t5_1.1_xxl | 11.14B | |
67
 
68
  __Arguments__
69