Penghui Qi

QPHutu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 6 days ago

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

Paper • 2503.01328 • Published 7 days ago • 14

upvoted an article 11 days ago

view article

Article

DualPipe could be better without the Dual

By •

11 days ago

• 15

upvoted 5 collections 3 months ago

⚓️ Sailor Language Models

Collection

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 17 items • Updated Dec 3, 2024 • 17

💡 DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28, 2024 • 9

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11, 2024 • 6

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26, 2024 • 8

🔱 Sailor2 Language Models

Collection

Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated 14 days ago • 26

upvoted a paper 4 months ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8, 2024 • 20

upvoted a paper 9 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24, 2024 • 3

upvoted a paper about 1 year ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 24