jinaai
/

jina-bert-flash-implementation

🇪🇺 Region: EU

Model card Files Files and versions Community

jina-bert-flash-implementation / mlp.py

Commit History

fixed GLU implementation, added conversion of layer norms

9587227

Markus28 commited on Mar 22, 2024

Added GLUMLP, changed config accordingly, added code to convert state_dict

0211324

Markus28 commited on Mar 22, 2024

reference the flash attention GitHub

eec6c0e

Markus28 commited on Mar 5, 2024

fix: move flash components into top-level

5944ec8

Markus28 commited on Mar 5, 2024