Efficient Exact Optimization
Collection
SFT & Reward Models used in the experiments of the ICML 2024 paper "Towards Efficient Exact Optimization of Language Model Alignment"
•
2 items
•
Updated
Towards Efficient Exact Optimization of Language Model Alignment
model: exo-imdb-sft-model
- Finetuned from model: gpt2-large
dataset: imdb (original stanford version)
SFT model used in the imdb experiment of the ICML'24 paper Towards Efficient Exact Optimization of Language Model Alignment.
For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md
- Downloads last month
- 12
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.