Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
•
2406.14491
•
Published
•
94
Instruction Pre-Training
-
-
86
Instruction Synthesizer
🐠Generate instruction-response pairs from text
-
instruction-pretrain/InstructLM-1.3B
Text Generation • Updated • 30 • 42 -
instruction-pretrain/InstructLM-500M
Text Generation • Updated • 46 • 34 -
instruction-pretrain/instruction-synthesizer
Text Generation • Updated • 91 • 78 -
instruction-pretrain/medicine-Llama3-8B
Text Generation • Updated • 81 • 38 -
instruction-pretrain/finance-Llama3-8B
Text Generation • Updated • 91k • 65 -
instruction-pretrain/ft-instruction-synthesizer-collection
Viewer • Updated • 249k • 2.71k • 61