Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mlabonne
/
OrpoLlama-3-8B
like
54
Text Generation
Transformers
Safetensors
mlabonne/orpo-dpo-mix-40k
English
llama
orpo
llama 3
rlhf
sft
conversational
text-generation-inference
Inference Endpoints
License:
other
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
7f200e4
OrpoLlama-3-8B
/
model-00002-of-00004.safetensors
Commit History
Upload LlamaForCausalLM
0ed5882
verified
mlabonne
commited on
Apr 20
Upload LlamaForCausalLM
180ab05
verified
mlabonne
commited on
Apr 18