instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Recent Activity

upvoted a paper 5 days ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

updated a dataset 13 days ago

instruction-pretrain/general-instruction-augmented-corpora

new activity 14 days ago

instruction-pretrain/ft-instruction-synthesizer-collection:Query about the size of dataset

View all activity

Organizations

None yet

models 5

instruction-pretrain/instruction-synthesizer

Text Generation • Updated Dec 21, 2024 • 495 • 77

instruction-pretrain/InstructLM-500M

Text Generation • Updated Dec 2, 2024 • 284 • 34

instruction-pretrain/medicine-Llama3-8B

Text Generation • Updated Dec 2, 2024 • 260 • 37

instruction-pretrain/InstructLM-1.3B

Text Generation • Updated Dec 2, 2024 • 51 • 42

instruction-pretrain/finance-Llama3-8B

Text Generation • Updated Dec 2, 2024 • 864 • 59

datasets 3

instruction-pretrain/general-instruction-augmented-corpora

Preview • Updated 13 days ago • 7.36k • 16

instruction-pretrain/medicine-instruction-augmented-corpora

Preview • Updated Dec 2, 2024 • 453 • 12

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Dec 2, 2024 • 249k • 743 • 61