A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k
- Downloads last month
- 7
Inference API (serverless) is not available, repository is disabled.
Model tree for eren23/DPOMixLLama-3-8B-lora
Base model
meta-llama/Meta-Llama-3-8B-Instruct
Adapter
this model