instruction-pretrain

instruction-pretrain's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 2 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 94

upvoted a paper 4 months ago

How to Synthesize Text Data without Model Collapse?

Paper • 2412.14689 • Published Dec 19, 2024 • 53

upvoted 2 papers 5 months ago

On Domain-Specific Post-Training for Multimodal Large Language Models

Paper • 2411.19930 • Published Nov 29, 2024 • 29

MH-MoE:Multi-Head Mixture-of-Experts

Paper • 2411.16205 • Published Nov 25, 2024 • 28

upvoted a paper 6 months ago

OmniGen: Unified Image Generation

Paper • 2409.11340 • Published Sep 17, 2024 • 115

upvoted 3 papers 7 months ago

Data Selection via Optimal Control for Language Models

Paper • 2410.07064 • Published Oct 9, 2024 • 8

Differential Transformer

Paper • 2410.05258 • Published Oct 7, 2024 • 178

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published Sep 25, 2024 • 63

upvoted 3 collections 10 months ago

synthetic-data-generation-demos

Collection

A collection of demos for various approaches to synthetic data generation • 4 items • Updated Jun 25, 2024 • 14

Instruction Pre-Training

Collection

8 items • Updated Jun 21, 2024 • 26

Daily paper that is inspiring (abstract is enough)

Collection

42 items • Updated Jul 19, 2024 • 1

upvoted a paper 10 months ago

Adapting Large Language Models via Reading Comprehension

Paper • 2309.09530 • Published Sep 18, 2023 • 78