Update README.md
Browse files
README.md
CHANGED
|
@@ -39,7 +39,10 @@ It's good. It goes page after page. It needs an authors note to stay on track
|
|
| 39 |
|
| 40 |
## Chat Template
|
| 41 |
|
| 42 |
-
It was trained to follow no prompt at all, just to start going. There is explicitly no chat in the training data. Simply double newline delimited (even with the orca, math, etc)
|
| 43 |
|
|
|
|
|
|
|
|
|
|
| 44 |
|
| 45 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="50"/>](https://github.com/unslothai/unsloth)
|
|
|
|
| 39 |
|
| 40 |
## Chat Template
|
| 41 |
|
| 42 |
+
It was trained to follow no prompt at all, just to start going; which means the best results are from when you start the story. There is explicitly no chat in the training data. Simply double newline delimited (even with the orca, math, etc).
|
| 43 |
|
| 44 |
+
## Issues
|
| 45 |
+
|
| 46 |
+
Punctuation isn't perfect, and has spacing issues, but I have yet to see it collapse even after dumping 40000 tokens in a rolling 8192 context.
|
| 47 |
|
| 48 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="50"/>](https://github.com/unslothai/unsloth)
|