legolasyiu
commited on
Commit
•
cdcbbcb
1
Parent(s):
ebdd08d
Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ tags:
|
|
18 |
- **Developed by:** EpistemeAI
|
19 |
- **License:** apache-2.0
|
20 |
- **Finetuned from model :** unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
|
21 |
-
- **Finetuned methods: DPO (Direct Preference Optimization)
|
22 |
|
23 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
24 |
|
|
|
18 |
- **Developed by:** EpistemeAI
|
19 |
- **License:** apache-2.0
|
20 |
- **Finetuned from model :** unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
|
21 |
+
- **Finetuned methods: DPO (Direct Preference Optimization) & ORPO (Odds Ratio Preference Optimization)**
|
22 |
|
23 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
24 |
|