Commit
•
f330ea9
1
Parent(s):
f3e02f1
Update README.md
Browse files
README.md
CHANGED
|
@@ -41,7 +41,7 @@ The purpose of releasing the **KafkaLM series** is to contribute to the German A
|
|
| 41 |
The main goal was to provide LLMs proficient in German, especially to be used in German-speaking business contexts where English alone is not sufficient.
|
| 42 |
|
| 43 |
|
| 44 |
-
##
|
| 45 |
|
| 46 |
Based on the brilliant work from [laserRMT](https://github.com/cognitivecomputations/laserRMT/) team, I used the SNR implementation for identifying candiate layers to be used for the DPO training.
|
| 47 |
|
|
|
|
| 41 |
The main goal was to provide LLMs proficient in German, especially to be used in German-speaking business contexts where English alone is not sufficient.
|
| 42 |
|
| 43 |
|
| 44 |
+
## DPO Training with laserRMT w/ Q-Lora
|
| 45 |
|
| 46 |
Based on the brilliant work from [laserRMT](https://github.com/cognitivecomputations/laserRMT/) team, I used the SNR implementation for identifying candiate layers to be used for the DPO training.
|
| 47 |
|