How to Train Long-Context Language Models (Effectively) Paper • 2410.02660 • Published Oct 3, 2024 • 2
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs Paper • 2402.15627 • Published Feb 23, 2024 • 35