Smallish LLM pre-training datasets - a gaunernst Collection

gaunernst 's Collections

Mini BERT models

Face Recognition Models

Smallish LLM pre-training datasets

Llama2-compatible

Llama3-compatible

Smallish LLM pre-training datasets

updated Sep 30

roneneldan/TinyStories

Viewer • Updated Aug 12 • 2.14M • 14.7k • 583

Note V2 - 2GB
allenai/c4

Viewer • Updated Jan 9 • 10.4B • 345k • 337

Note realnewslike subset - 15GB
HuggingFaceFW/fineweb-edu

Viewer • Updated 6 days ago • 3B • 329k • 572

Note sample-10BT subset - 28GB
HuggingFaceTB/smollm-corpus

Viewer • Updated Sep 6 • 237M • 76.6k • 269
cerebras/SlimPajama-627B

Preview • Updated Jul 7, 2023 • 45.7k • 437