Update index.html
Browse files- index.html +1 -1
index.html
CHANGED
@@ -138,7 +138,7 @@
|
|
138 |
but we have not trained
|
139 |
beyond data set sizes with orders of magnitudes above 100 million words.
|
140 |
Watch this space!</li>
|
141 |
-
<li>They <b>do not have a delicate attention mechanism</b
|
142 |
of Transformer-based decoders;</li>
|
143 |
<li>Memory requirements during training are <b>heavy with large datasets</b>
|
144 |
(more than 32 GB RAM with more than 100 million words);</li>
|
|
|
138 |
but we have not trained
|
139 |
beyond data set sizes with orders of magnitudes above 100 million words.
|
140 |
Watch this space!</li>
|
141 |
+
<li>They <b>do not have a delicate attention mechanism</b>, arguably the killer feature
|
142 |
of Transformer-based decoders;</li>
|
143 |
<li>Memory requirements during training are <b>heavy with large datasets</b>
|
144 |
(more than 32 GB RAM with more than 100 million words);</li>
|