RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
35
•
7
Xiaosen Zheng
xszheng2020
AI & ML interests
Data-Centric AI and AI Safety.
Recent Activity
liked
a model
5 days ago
hugging-quants/gemma-2-9b-it-AWQ-INT4
liked
a model
5 days ago
Qwen/Qwen2.5-7B-Instruct-AWQ
liked
a dataset
7 days ago
m-a-p/FineFineWeb
Organizations
xszheng2020's activity
commented
a
paper
4 months ago