Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
brainstorm 40x
swearing
rp
horror
llama3
mergekit
Inference Endpoints
conversational
Full Weights Request
#2
by
James2313123
- opened
Hey David! This model works great for RP. I wanted to make an EXL2 quant. Would it be possible for you to upload the full weights? Thanks.
4bpw EXL2 quant of L3-Darker-Planet-12.15B is up on my page too: [ https://huggingface.co/James2313123/L3-Darker-Planet-12.15B_4bpw-h6-EXL2 ]
I also discovered that for EXL2, these settings down below most importantly have to be disabled in Silly Tavern or else the model will spit gibberish at Temps 1+
This comment has been hidden
Nvm figured Do Sample and Skip Special Tokens have to be turned on. As for gibberish at higher temps, Smoothing factor needs to be bumped up for eg, 1.5 smoothing factor at temp 3.0