Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
anshikaagarwal
/
llama-3.2-1B-instruct-dpo
like
0
PEFT
Safetensors
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Use this model
main
llama-3.2-1B-instruct-dpo
/
adapter_config.json
Commit History
Uploading merged DPO-trained model
4238367
verified
anshikaagarwal
commited on
about 1 month ago