Efficient Exact Optimization
Collection
SFT & Reward Models used in the experiments of the ICML 2024 paper "Towards Efficient Exact Optimization of Language Model Alignment"
•
2 items
•
Updated
Towards Efficient Exact Optimization of Language Model Alignment
model: exo-imdb-reward-model
- Finetuned from model: gpt2-large
dataset: imdb (original stanford version)
Reward model used in the imdb experiment of the ICML'24 paper Towards Efficient Exact Optimization of Language Model Alignment.
For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md
- Downloads last month
- 7
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.