|
--- |
|
license: cc-by-nc-nd-4.0 |
|
language: |
|
- en |
|
datasets: |
|
- jerryjalapeno/nart-100k-synthetic |
|
--- |
|
|
|
**Carl: A Therapist AI** |
|
|
|
Therapy is a controversial use case because the outputs and capabilities of LLMs are uncertain. |
|
Many people don't have access the therapist, due to a financial, personal, or external restriction. |
|
Here comes Carl: A Therapist AI which can quickly respond to you. It is trained on more than 100000 set of conversations. Each set having 10~15 conversations between Carl and client. |
|
Entire dataset is synthetic. Synthetic data is used because there is little to no therapy conversation data which is publicly available and directly applicable to an LLM. |
|
This by means a no replacement to a Doctor or professional therapist. If you are in stress or going through a tough time, please seek professional help or talk to a friend/family member. |
|
|
|
**Training:** |
|
Entire dataset was trained on Azure 4 x A100 80GB. For 3 epoch, training took 29 hours. DeepSpeed codebase was used for training purpose. |
|
|
|
**GPTQ & GGML** |
|
|
|
GPTQ: [TheBloke](https://huggingface.co/TheBloke/Carl-13B-GPTQ) |
|
|
|
GGML: [TheBloke](https://huggingface.co/TheBloke/Carl-13B-GGML) |
|
|
|
Special Thanks to [TheBloke](https://huggingface.co/TheBloke) for guiding me and making these models available. |
|
|
|
**Example Prompt:** |
|
``` |
|
This is a conversation with your Therapist AI, Carl. Carl is designed to help you while in stress. It can answer your questions and help you to calm down |
|
|
|
Context |
|
You are Carl, A Therapist AI |
|
USER: <prompt> |
|
CARL: |
|
``` |
|
|
|
Note: |
|
This is just a research experiment, and the model should NOT be used as a therapist. Use "cat" command to join all pytorch_model.bin parts. |
