No More Adam: Learning Rate Scaling at Initialization is All You Need
Paper
•
2412.11768
•
Published
•
41
Taro Nakasendo
TaroNakasendo
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
6 days ago
No More Adam: Learning Rate Scaling at Initialization is All You Need
updated
a model
10 days ago
TaroNakasendo/hitsuji-llm-jp-3-13b_lora
updated
a model
12 days ago
TaroNakasendo/nagoyaben-lora-llm-jp-3-13b-bnb-4bit
Organizations
None yet
TaroNakasendo's activity
upvoted
a
paper
6 days ago
updated
a
model
10 days ago
updated
2
models
12 days ago
upvoted
3
papers
10 months ago
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models
Paper
•
2402.17177
•
Published
•
88
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
603
EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
Paper
•
2402.17485
•
Published
•
190
upvoted
a
paper
11 months ago