WPO
Collection
Models and datasets in paper "WPO: Enhancing RLHF with Weighted Preference Optimization".
•
11 items
•
Updated
•
6
Description
Llama3-Instruct-8B model finetuned by off-polciy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.
License
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
- Downloads last month
- 9
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.