antalvdb commited on
Commit
4970c55
·
verified ·
1 Parent(s): e14d4fe

Update index.html

Browse files
Files changed (1) hide show
  1. index.html +1 -1
index.html CHANGED
@@ -138,7 +138,7 @@
138
  but we have not trained
139
  beyond data set sizes with orders of magnitudes above 100 million words.
140
  Watch this space!</li>
141
- <li>They <b>do not have a delicate attention mechanism</b>b>, arguably the killer feature
142
  of Transformer-based decoders;</li>
143
  <li>Memory requirements during training are <b>heavy with large datasets</b>
144
  (more than 32 GB RAM with more than 100 million words);</li>
 
138
  but we have not trained
139
  beyond data set sizes with orders of magnitudes above 100 million words.
140
  Watch this space!</li>
141
+ <li>They <b>do not have a delicate attention mechanism</b>, arguably the killer feature
142
  of Transformer-based decoders;</li>
143
  <li>Memory requirements during training are <b>heavy with large datasets</b>
144
  (more than 32 GB RAM with more than 100 million words);</li>