cleanrl

cleanrl's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

vwxyzjn 

authored 5 papers 3 months ago

The N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarization

Paper • 2403.17031 • Published Mar 24, 2024 • 6

A2C is a special case of PPO

Paper • 2205.09123 • Published May 18, 2022 • 1

Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Models

Paper • 2410.18252 • Published Oct 23, 2024 • 7

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training

Paper • 2411.15124 • Published Nov 22, 2024 • 62

2 OLMo 2 Furious

Paper • 2501.00656 • Published Dec 31, 2024 • 19

ArashAhmadian 

authored a paper 3 months ago

If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs

Paper • 2412.04144 • Published Dec 5, 2024 • 5

ArashAhmadian 

authored 2 papers 9 months ago

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs

Paper • 2407.02552 • Published Jul 2, 2024 • 4

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

Paper • 2309.05444 • Published Sep 11, 2023 • 1

ArashAhmadian 

authored a paper 10 months ago

Self-Improving Robust Preference Optimization

Paper • 2406.01660 • Published Jun 3, 2024 • 20

vwxyzjn 

updated 3 models 10 months ago

cleanrl/EleutherAI_pythia-6.9b-deduped__ppo__tldr

Text Generation • Updated May 30, 2024 • 37

cleanrl/EleutherAI_pythia-2.8b-deduped__ppo__tldr

Text Generation • Updated May 30, 2024 • 33

cleanrl/EleutherAI_pythia-1b-deduped__ppo__tldr

Text Generation • Updated May 30, 2024 • 19

ArashAhmadian 

authored a paper 10 months ago

Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs

Paper • 2402.14740 • Published Feb 22, 2024 • 13

vwxyzjn 

updated 5 models 10 months ago

cleanrl/EleutherAI_pythia-2.8b-deduped__reward__tldr

Text Classification • Updated May 15, 2024 • 170

cleanrl/EleutherAI_pythia-1b-deduped__reward__tldr

Text Classification • Updated May 15, 2024 • 5.74k

cleanrl/EleutherAI_pythia-1b-deduped__sft__tldr

Text Generation • Updated May 15, 2024 • 7.25k

cleanrl/EleutherAI_pythia-2.8b-deduped__sft__tldr

Text Generation • Updated May 15, 2024 • 232

cleanrl/EleutherAI_pythia-6.9b-deduped__sft__tldr

Text Generation • Updated May 15, 2024 • 191

vwxyzjn 

updated 2 models 11 months ago

cleanrl/EleutherAI_pythia-6.9b-deduped__reward__tldr

Text Classification • Updated May 7, 2024 • 201

cleanrl/ppo_zephyr310

Text Generation • Updated May 1, 2024 • 5