Sillytavern Presets
Collection
1 item
•
Updated
•
3
v1.9 is still recommended
v2.0 is simmilar to v1.9 | json is a master import.
Samplers are just for messing around
Turn on trim if you like it I just suffer from FOMO.
Thanks to:
SerialKicked for fixing context
saishf for testing all the bad versions
Lewdiculous for testing and quantizing
Herman555 for reminding me that some models need a jailbreak
Clevyby for sharing their sampler knowledge
shrinkedd for ideas
SillyTavern Presets
Usage
Make sure to grab both context and instruct templates. It should look something like this.
When using these presets you must set Example Messages Behavior: Never include examples otherwise they will be sent twice.
The reason for this, is because I explicitly set for them to be sent. The default behavior is for them to just be added at the end of the context prompt.
Character Cards
The following is just personal preference. However, it is recommended for a better experience.
Create a new neutral persona(USER_01)
For scenario, use a really vague description. This is to prevent the LLM from locking in. (Unless you want that)
I am currently running https://github.com/gaffe-buck/tavern-v2-character-creator inside a container
Choosing a mode
Prepend one of the following, before your request.
> Text Editor
> Character Creator
> Flexible P-list Formatter
> Ali-chat Generator
> Opening Scenario Writer
Example:
> Text Editor
---
Re-write the scenario in a dark fantasy philosophical style.
Example:
> Opening Scenario Writer
Create an opening scene for Char, Char enters a coffee shop.
> Text Editor
Re-write Char's opening scenario, in a dark comedy style.
Samplers
I have decided to remove old samplers and only keep basic presets, I want people to play around and find what works best for them. Change context to desired context length
Temperature Feel free to play with this one, lower values are more grounded.
Min-P Higher values chop off more probabilities.
Values between 0.025 - 0.10 are good, personally I would use 0.075 or lower.
Repetition Penalty Tries to decrease repetition.
Do not set it higher than 1.2.
1.05 - 1.15 seem to work fine.
Rep Pen Range The range of tokens which Repetition Penalty can see. I have it set to 2048.
Frequency Penalty Decreases repetition.
Presence Penalty Increases word variety.
Dynamic Temperature Min and Max temps, free to change as desired.
Exponent, do not set Exponent higher than the default of 1.
You might want to try playing around and setting it lower than 1, this pushes lower probabilies higher.
When setting exponent lower than 1, set Min-P a little higher (0.075)
Smooth Sampling This one is great, smoothens out probabilities.
Lower is more diverse.
Recommended range 0.1 - 0.3