Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,15 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
datasets:
|
| 4 |
+
- adamo1139/uninstruct-v1-experimental-chatml
|
| 5 |
+
- adamo1139/HESOYAM_v0.3
|
| 6 |
+
tags:
|
| 7 |
+
- galore
|
| 8 |
+
---
|
| 9 |
+
## Basic Model Info
|
| 10 |
+
1 epoch on adamo1139/uninstruct-v1-experimental-chatml and then 1 epoch on adamo1139/HESOYAM_v0.3. I used [GaLore](https://arxiv.org/abs/2403.03507) for both stages.
|
| 11 |
+
|
| 12 |
+
This is a model trained on only human data, finetuned to behave like a person on 4chan board /x/ or redditor. Data used has comments from 1 4chan board "paranormal" and about 10 reddit subreddits. There's also a pippa in case you want to roleplay. Have a look at dataset to know what to expect.
|
| 13 |
+
|
| 14 |
+
Use ChatML prompt format with a system prompt like those in adamo1139/HESOYAM_v0.3, so `A chat on 4chan` or `A chat on subreddit /r/wallstreetbets`. It behaves like OpenAI slopped model with system prompt `A chat` so I advise you to avoid using that.
|
| 15 |
+
|