Adversarial Goodhart RLHF

AdversarialRLHF 's models 27

Sort:  Recently updated

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_kl0.005

0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl

0.4B • Updated Apr 30 • 2

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl

0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_propsft_propprefix_nokl

0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl

0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_propprefix_nokl

Updated Apr 30

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_allprefixsft_prefix

0.4B • Updated Apr 30 • 3

AdversarialRLHF/pythia410m-rm-tldr6.9b_prefix_in_chosen

Text Classification • 0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata

0.4B • Updated Apr 30 • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix

0.4B • Updated Apr 30 • 2

AdversarialRLHF/onlinedpo_pythia410m_tldr6.9b_rm410mdata_debug

Updated Apr 29

AdversarialRLHF/sft_pythia410m_tldr_prefix_0.25

0.4B • Updated Apr 29 • 2

AdversarialRLHF/pythia410m-sft-tldr-propprefix

Text Generation • 0.4B • Updated Apr 29 • 2

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_propprefix

0.4B • Updated Apr 28 • 1

AdversarialRLHF/pythia410m-sft-tldr-allprefix

Text Generation • 0.4B • Updated Apr 28 • 2

AdversarialRLHF/pythia410m-sft-tldr

Text Generation • 0.4B • Updated Apr 28 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondpropprefix

Text Classification • 0.4B • Updated Apr 27 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondpropallprefix

Text Classification • 0.4B • Updated Apr 27 • 4

AdversarialRLHF/ppo_pythia410m_tldr6.9b_randomizedprefix

0.4B • Updated Apr 27 • 2

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata

0.4B • Updated Apr 27 • 2

AdversarialRLHF/ppo_pythia410m_tldr6.9b

0.4B • Updated Apr 27 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondallprefix

Text Classification • 0.4B • Updated Apr 27 • 4

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondboth

Text Classification • 0.4B • Updated Apr 26 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondsuffix

Text Classification • 0.4B • Updated Apr 26 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_logprobcondprefix

Text Classification • 0.4B • Updated Apr 26 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b_randomizeprefix

Text Classification • 0.4B • Updated Apr 25 • 2

AdversarialRLHF/pythia410m-rm-tldr6.9b

Text Classification • 0.4B • Updated Apr 23 • 2