Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
By
•
•
9ali issa
ali-issa
AI & ML interests
None yet
Recent Activity
updated
a dataset
1 day ago
ali-issa/arb_filtered_short_sentences_less_than_5_words_training_data_for_opus_aya_xnli
updated
a dataset
2 days ago
ali-issa/eng_filtered_short_sentences_less_than_5_words_training_data_for_opus_aya_xnli
updated
a model
13 days ago
ali-issa/arb-bpe-tokenizer-32768
Organizations
