---
license: apache-2.0
---

# Towards Efficient Exact Optimization of Language Model Alignment

- **model**: [exo-imdb-sft-model](https://huggingface.co/ehzoah/exo-imdb-sft-model)

  - Finetuned from model: [gpt2-large](https://huggingface.co/openai-community/gpt2-large)

- **dataset**: [imdb](https://ai.stanford.edu/~amaas/data/sentiment/aclImdb_v1.tar.gz) (original stanford version)

SFT model used in the imdb experiment of the ICML'24 paper [*Towards Efficient Exact Optimization of Language Model Alignment*](https://arxiv.org/pdf/2402.00856).

For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md