Data Selection

community

https://github.com/microsoft/LMOps/tree/main/data_selection

AI & ML interests

Data Selection for Language Models

Collections 2

models 9

Data-Selection/data_scorer

Updated Jan 5 • 10

Data-Selection/BSL-1B

Text Generation • Updated Oct 28, 2024 • 53

Data-Selection/BSL-1.7B

Text Generation • Updated Oct 28, 2024 • 52

Data-Selection/BSL-470M

Text Generation • Updated Oct 28, 2024 • 53

Data-Selection/BSL-160M

Text Generation • Updated Oct 28, 2024 • 57

Data-Selection/PDS-1.7B

Text Generation • Updated Oct 28, 2024 • 20

Data-Selection/PDS-1B

Text Generation • Updated Oct 28, 2024 • 53

Data-Selection/PDS-470M

Text Generation • Updated Oct 28, 2024 • 67

Data-Selection/PDS-160M

Text Generation • Updated Oct 28, 2024 • 53

datasets

None public yet