Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference Paper • 2412.13663 • Published 7 days ago • 103
No More Adam: Learning Rate Scaling at Initialization is All You Need Paper • 2412.11768 • Published 9 days ago • 40
