Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ datasets:
|
|
20 |
- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
|
21 |
- mpasila/Sonnet3.5-SlimOrcaDedupCleaned-4k-context
|
22 |
---
|
23 |
-
This is a test model because the previous attempt failed. So it turns out I also trained this incorrectly due to the dataset using wrongly formatted ShareGPT so after I trained
|
24 |
|
25 |
Prompt format is: ChatML
|
26 |
|
|
|
20 |
- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
|
21 |
- mpasila/Sonnet3.5-SlimOrcaDedupCleaned-4k-context
|
22 |
---
|
23 |
+
This is a test model because the previous attempt failed. So it turns out I also trained this incorrectly due to the dataset using wrongly formatted ShareGPT so after I trained it again "correctly" for another full epoch I noticed that so.. I will have to train it yet again.. but at least now it should be fixed. But this model is using the wrongly formatted dataset. The next model should be better.
|
24 |
|
25 |
Prompt format is: ChatML
|
26 |
|