Update README.md
Browse files
README.md
CHANGED
@@ -41,9 +41,9 @@ Instructions placed here.<|im_end|>
|
|
41 |
The model's response will be here.<|im_end|>
|
42 |
--------------------------------------------------
|
43 |
[INST]system
|
44 |
-
This is
|
45 |
[INST]user
|
46 |
-
|
47 |
[INST]assistant
|
48 |
The model's response will be here.[/INST]
|
49 |
```
|
@@ -51,7 +51,7 @@ The model's response will be here.[/INST]
|
|
51 |
# Recommended Samplers:
|
52 |
|
53 |
```
|
54 |
-
Temperature: 0.
|
55 |
min_p: 0.1 - 0.2 # Crucial for NeMo
|
56 |
```
|
57 |
|
@@ -63,6 +63,8 @@ min_p: 0.1 - 0.2 # Crucial for NeMo
|
|
63 |
[/INST]
|
64 |
```
|
65 |
|
|
|
|
|
66 |
# Notes
|
67 |
|
68 |
\- Some people have been having issues with run-on generations for Lyra-v3. Kind of weird, when I never had issues.
|
|
|
41 |
The model's response will be here.<|im_end|>
|
42 |
--------------------------------------------------
|
43 |
[INST]system
|
44 |
+
This is another system prompt.[/INST]
|
45 |
[INST]user
|
46 |
+
Your instructions placed here.[/INST]
|
47 |
[INST]assistant
|
48 |
The model's response will be here.[/INST]
|
49 |
```
|
|
|
51 |
# Recommended Samplers:
|
52 |
|
53 |
```
|
54 |
+
Temperature: 0.6 - 1 # I recommend lowering it a litte for v4?
|
55 |
min_p: 0.1 - 0.2 # Crucial for NeMo
|
56 |
```
|
57 |
|
|
|
63 |
[/INST]
|
64 |
```
|
65 |
|
66 |
+
*Introduces run-off generations at times, as seen in v2a2. It's layered on top of older models, so eh, makes sense. Easy to cut out though.*
|
67 |
+
|
68 |
# Notes
|
69 |
|
70 |
\- Some people have been having issues with run-on generations for Lyra-v3. Kind of weird, when I never had issues.
|