sphiratrioth666 commited on
Commit
c0d6d40
1 Parent(s): 65e6a67

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -91,7 +91,7 @@ base_model:
91
  **Advanced Users:** Enjoy, modify, forget.\
92
  **Beginners:** Read further.
93
 
94
- <p align="justify">1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
95
  ***<<< Most typical templates: Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion >>>***
96
  2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
97
  ***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
@@ -110,12 +110,12 @@ base_model:
110
  15. Load up my Settings Preset from the Text Completion Presets list.
111
  16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
112
  17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
113
- 18. Enjoy.</p>
114
  <br>
115
  <br>
116
  <h1><ins>BEWARE:</ins></h1>
117
 
118
- **IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLEPLAY. IF YOU "HOT" SWAP THE PRESETS, YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH PROPERLY. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.**
119
 
120
  <h1><ins>CUSTOMIZATION:</ins></h1>
121
  <li>Dialogues in Markdowns - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). It's simple - find the following line and replace with: Respect this markdown format: "direct speech", *actions*</li>
 
91
  **Advanced Users:** Enjoy, modify, forget.\
92
  **Beginners:** Read further.
93
 
94
+ 1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
95
  ***<<< Most typical templates: Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion >>>***
96
  2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
97
  ***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
 
110
  15. Load up my Settings Preset from the Text Completion Presets list.
111
  16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
112
  17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
113
+ 18. Enjoy.
114
  <br>
115
  <br>
116
  <h1><ins>BEWARE:</ins></h1>
117
 
118
+ <p align="justify">**IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLEPLAY. IF YOU "HOT" SWAP THE PRESETS, YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH PROPERLY. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.**</p>
119
 
120
  <h1><ins>CUSTOMIZATION:</ins></h1>
121
  <li>Dialogues in Markdowns - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). It's simple - find the following line and replace with: Respect this markdown format: "direct speech", *actions*</li>