Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
•
2406.14491
•
Published
•
91
•
25
instruction-pretrain
instruction-pretrain
AI & ML interests
Synthetic Instructions for Pre-Training
Recent Activity
updated
a model
20 days ago
instruction-pretrain/InstructLM-500M
updated
a model
20 days ago
instruction-pretrain/InstructLM-1.3B
updated
a dataset
24 days ago
instruction-pretrain/ft-instruction-synthesizer-collection
Organizations
None yet
instruction-pretrain's activity
Delete images
#3 opened 26 days ago
by
instruction-pretrain
Query about the size of dataset
1
#4 opened 5 months ago
by
Applauz
Continued pre-training with replay?
1
#4 opened about 2 months ago
by
ostapeno
Adding `safetensors` variant of this model
#1 opened 4 months ago
by
SFconvertbot
How large is the corpus size used for pretraining the finance LLaMA?
1
#2 opened 6 months ago
by
dhkong
commented
2
papers
7 months ago
Update README.md
#2 opened 7 months ago
by
instruction-pretrain
Update README.md
#2 opened 7 months ago
by
instruction-pretrain
Update README.md
#2 opened 7 months ago
by
instruction-pretrain
Update README.md
#1 opened 7 months ago
by
AdaptLLM
Can you share the training code for the instruction synthesizer？
5
#2 opened 9 months ago
by
chenff35
commented
2
papers
8 months ago
Update README.md
#3 opened 8 months ago
by
AdaptLLM
Update README.md
#2 opened 8 months ago
by
instruction-pretrain
Update README.md
#4 opened 8 months ago
by
instruction-pretrain
Update README.md
#5 opened 8 months ago
by
instruction-pretrain
