InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU Paper • 2502.08910 • Published 25 days ago • 143
view article Article Releasing the largest multilingual open pretraining dataset By Pclanglais and 2 others • Nov 13, 2024 • 100
view article Article A failed experiment: Infini-Attention, and why we should keep trying? Aug 14, 2024 • 60
view article Article Welcome FalconMamba: The first strong attention-free 7B model Aug 12, 2024 • 108