🦙📚 LlamaTales - a ivnle Collection

ivnle 's Collections

updated Nov 11, 2024

Datasets and checkpoints from the paper LlamaTales: Studying the Effects of Developmentally Inspired Training Data on Small Language Models

Upvote

ivnle/llamatales-gre-70b

Viewer • Updated Nov 8, 2024 • 2M • 114

Note Short stories generated by `nvidia/Llama-3.1-Nemotron-70B-Instruct`.
ivnle/llamatales-jr-70b

Viewer • Updated Nov 9, 2024 • 3.56M • 88

Note Children's stories generated by `nvidia/Llama-3.1-Nemotron-70B-Instruct`.
ivnle/llamatales-gre

Viewer • Updated Oct 21, 2024 • 2.02M • 102

Note Short stories generated by `meta-llama/Llama-3.1-8B-Instruct`.
ivnle/llamatales-jr

Viewer • Updated Oct 22, 2024 • 3.59M • 163

Note Children's stories generated by `meta-llama/Llama-3.1-8B-Instruct`.
ivnle/tinystories

Viewer • Updated Oct 22, 2024 • 4.97M • 97

Note Source: https://huggingface.co/datasets/roneneldan/TinyStories/blob/main/TinyStories_all_data.tar.gz
ivnle/fineweb

Viewer • Updated Oct 22, 2024 • 2.03M • 68

Note 1B token sample of FineWeb-Edu https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu Model checkpoints below. Naming format is [training data]-[layers]-[hidden size]-[heads]-[non-embedding parameter count].
ivnle/llamatales_gre_8b-lay8-hs512-hd8-33M

Text Generation • Updated Nov 14, 2024 • 46
ivnle/llamatales_gre_8b-lay8-hs384-hd6-18M

Text Generation • Updated Nov 14, 2024 • 44
ivnle/llamatales_gre_8b-lay4-hs384-hd6-9M

Text Generation • Updated Nov 14, 2024 • 44
ivnle/llamatales_gre_8b-lay4-hs128-hd2-1M

Text Generation • Updated Nov 14, 2024 • 47
ivnle/llamatales_gre_8b-lay2-hs128-hd2-524K

Text Generation • Updated Nov 14, 2024 • 43
ivnle/llamatales_gre_8b-lay1-hs128-hd2-262K

Text Generation • Updated Nov 14, 2024 • 42
ivnle/fineweb-lay8-hs512-hd8-33M

Text Generation • Updated Nov 14, 2024 • 49
ivnle/fineweb-lay8-hs384-hd6-18M

Text Generation • Updated Nov 14, 2024 • 44
ivnle/fineweb-lay4-hs384-hd6-9M

Text Generation • Updated Nov 14, 2024 • 48
ivnle/fineweb-lay4-hs128-hd2-1M

Text Generation • Updated Nov 14, 2024 • 46
ivnle/fineweb-lay2-hs128-hd2-524K

Text Generation • Updated Nov 14, 2024 • 46
ivnle/fineweb-lay1-hs128-hd2-262K

Text Generation • Updated Nov 14, 2024 • 47
ivnle/llamatales_jr_8b-lay8-hs512-hd8-33M

Text Generation • Updated Nov 14, 2024 • 48
ivnle/llamatales_jr_8b-lay8-hs384-hd6-18M

Text Generation • Updated Nov 14, 2024 • 43
ivnle/llamatales_jr_8b-lay4-hs384-hd6-9M

Text Generation • Updated Nov 14, 2024 • 42
ivnle/llamatales_jr_8b-lay4-hs128-hd2-1M

Text Generation • Updated Nov 14, 2024 • 43
ivnle/llamatales_jr_8b-lay2-hs128-hd2-524K

Text Generation • Updated Nov 14, 2024 • 45
ivnle/llamatales_jr_8b-lay1-hs128-hd2-262K

Text Generation • Updated Nov 14, 2024 • 45
ivnle/tinystories-lay8-hs512-hd8-33M

Text Generation • Updated Nov 14, 2024 • 50
ivnle/tinystories-lay8-hs384-hd6-18M

Text Generation • Updated Nov 14, 2024 • 41
ivnle/tinystories-lay4-hs384-hd6-9M

Text Generation • Updated Nov 14, 2024 • 45
ivnle/tinystories-lay4-hs128-hd2-1M

Text Generation • Updated Nov 14, 2024 • 43
ivnle/tinystories-lay2-hs128-hd2-524K

Text Generation • Updated Nov 14, 2024 • 45
ivnle/tinystories-lay1-hs128-hd2-262K

Text Generation • Updated Nov 14, 2024 • 41

Upvote