File size: 1,662 Bytes
ebf3ffe
 
b4a3b18
 
0d7f199
 
ebf3ffe
b4a3b18
 
 
 
 
 
 
 
 
 
80973b3
b4a3b18
6cd029d
 
 
 
 
 
 
 
b4a3b18
 
 
 
 
 
 
 
 
 
 
0d7f199
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
---
license: cc-by-nc-nd-4.0
language:
- en
datasets:
- jerryjalapeno/nart-100k-synthetic
---

**Carl: A Therapist AI**

Therapy is a controversial use case because the outputs and capabilities of LLMs are uncertain. 
Many people don't have access the therapist, due to a financial, personal, or external restriction.
Here comes Carl: A Therapist AI which can quickly respond to you. It is trained on more than 100000 set of conversations. Each set having 10~15 conversations between Carl and client.
Entire dataset is synthetic. Synthetic data is used because there is little to no therapy conversation data which is publicly available and directly applicable to an LLM.
This by means a no replacement to a Doctor or professional therapist. If you are in stress or going through a tough time, please seek professional help or talk to a friend/family member.

**Training:**
Entire dataset was trained on Azure 4 x A100 80GB. For 3 epoch, training took 29 hours. DeepSpeed codebase was used for training purpose. 

**GPTQ & GGML**

GPTQ: [TheBloke](https://huggingface.co/TheBloke/Carl-13B-GPTQ)

GGML: [TheBloke](https://huggingface.co/TheBloke/Carl-13B-GGML)

Special Thanks to [TheBloke](https://huggingface.co/TheBloke) for guiding me and making these models available. 

**Example Prompt:**
```
This is a conversation with your Therapist AI, Carl. Carl is designed to help you while in stress. It can answer your questions and help you to calm down

Context
You are Carl, A Therapist AI
USER: <prompt>
CARL:
```

Note:
This is just a research experiment, and the model should NOT be used as a therapist. Use "cat" command to join all pytorch_model.bin parts.