Text Generation
Transformers
PyTorch
mistral
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Norquinal commited on
Commit
e2dc384
1 Parent(s): 00dd8da

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - Squish42/bluemoon-fandom-1-1-rp-cleaned
4
+ - OpenLeecher/Teatime
5
+ - PygmalionAI/PIPPA
6
+ tags:
7
+ - not-for-all-audiences
8
+ - nsfw
9
+ ---
10
+ ## What is PetrolLM-Claude-Chat?
11
+ PetrolLM-Claude-Chat is the [Mistral-7B-claude-chat](https://huggingface.co/Norquinal/Mistral-7B-claude-chat) model with the [PetrolLoRA](https://huggingface.co/Norquinal/PetrolLoRA) applied.
12
+
13
+ The dataset consists of 2800 samples, with the composition as follows:
14
+ * AICG Logs (~34%)
15
+ * PygmalionAI/PIPPA (~33%)
16
+ * Squish42/bluemoon-fandom-1-1-rp-cleaned (~29%)
17
+ * OpenLeecher/Teatime (~4%)
18
+
19
+ These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
20
+
21
+ ## Prompt Format
22
+ The model uses the following prompt format:
23
+ ```
24
+ ---
25
+ style: roleplay
26
+ characters:
27
+ [char]: [description]
28
+ summary: [scenario]
29
+ ---
30
+ <chat_history>
31
+ Format:
32
+ [char]: [message]
33
+ Human: [message]
34
+ ```
35
+
36
+ ## Use in Text Generation Web UI
37
+ Install the bleeding-edge version of `transformers` from source:
38
+ ```
39
+ pip install git+https://github.com/huggingface/transformers
40
+ ```
41
+ Or, alternatively, change `model_type` in `config.json` from `mistral` to `llama`.
42
+
43
+ ## Use in SillyTavern UI
44
+ ![](https://files.catbox.moe/2dkr28.png)
45
+ As an addendum, you can include one of the following as the `Last Output Sequence`:
46
+ ```
47
+ Human: In your next reply, write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.
48
+ {{char}}:
49
+ ```
50
+ ```
51
+ {{char}} (2 paragraphs, engaging, natural, authentic, descriptive, creative):
52
+ ```
53
+ ```
54
+ [System note: Write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.]
55
+ {{char}}:
56
+ ```
57
+ The third one seems to work the best. I would recommend experimenting with creating your own to best suit your needs.