DPO datasets
updated
Viewer • Updated • 7.5k • 690
• 184
argilla/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 8.04k
• 193
llamafactory/DPO-En-Zh-20k
Viewer • Updated • 20k • 340
• 106
argilla/distilabel-intel-orca-dpo-pairs
Viewer • Updated • 12.9k • 9.09k
• 188
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 11.5k
• 175
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 253
• 88
M4-ai/prm_dpo_pairs_cleaned
Viewer • Updated • 7.99k • 45
• 11
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 722
• 142
YeungNLP/ultrafeedback_binarized
Viewer • Updated • 63.1k • 20
• 1
shibing624/DPO-En-Zh-20k-Preference
Viewer • Updated • 20k • 131
• 18
Preview • Updated • 57
• 6
mlabonne/orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 525
• 318
Viewer • Updated • 15.3k • 98
• 20
jondurbin/gutenberg-dpo-v0.1
Viewer • Updated • 918 • 743
• 176
CyberNative/Code_Vulnerability_Security_DPO
Viewer • Updated • 4.66k • 2.06k
• 190
mlabonne/orpo-dpo-mix-40k-flat
Viewer • Updated • 44.2k • 41
• 17
selimc/orpo-dpo-mix-TR-20k
Viewer • Updated • 19.9k • 86
• 7
efederici/alpaca-vs-alpaca-orpo-dpo
Viewer • Updated • 49.2k • 117
• 7
Viewer • Updated • 2.42k • 34
• 10
allenai/llama-3.1-tulu-3-8b-preference-mixture
Viewer • Updated • 273k • 4.07k
• 28
allenai/llama-3.1-tulu-3-70b-preference-mixture
Viewer • Updated • 337k • 341
• 19
HuggingFaceH4/ultrafeedback_binarized
Viewer • Updated • 187k • 34.5k
• 363
Viewer • Updated • 83.1k • 2.53k
• 227
allenai/llama-3.1-tulu-3-405b-preference-mixture
Viewer • Updated • 361k • 153
• 7
Viewer • Updated • 450k • 118k
• 823
qihoo360/Light-R1-DPOData
Viewer • Updated • 2.97k • 543
• 29