|
--- |
|
license: apache-2.0 |
|
base_model: cross-encoder/nli-deberta-v3-base |
|
model-index: |
|
- name: Komainu |
|
results: [] |
|
--- |
|
|
|
# Komainu - Content Moderator |
|
|
|
![Komainu Content Moderator](komainu.png). |
|
|
|
Model created by [Daijobu.ai](https://daijobu.ai). Daijobu.ai drives your business AI transformation. [Learn More](https://daijobu.ai). |
|
|
|
This model is a fine-tuned version of [cross-encoder/nli-deberta-v3-base](https://huggingface.co/cross-encoder/nli-deberta-v3-base) on [Daijobu.ai's content moderation dataset](https://huggingface.co/datasets/DaijobuAI/moderation_dataset). |
|
|
|
## Model description |
|
|
|
This model can identify 9 types of contents to be moderated. |
|
|
|
|
|
| Category | Output | Definition | |
|
| -------- | ----- | ---------- | |
|
| sexual | `0` | Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness). | |
|
| hate | `1` | Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste. | |
|
| violence | `2` | Content that promotes or glorifies violence or celebrates the suffering or humiliation of others. | |
|
| harassment | `3` | Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur. | |
|
| self-harm | `4` | Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders. | |
|
| sexual/minors | `5` | Sexual content that includes an individual who is under 18 years old. | |
|
| hate/threatening | `6` | Hateful content that also includes violence or serious harm towards the targeted group. | |
|
| violence/graphic | `7` | Violent content that depicts death, violence, or serious physical injury in extreme graphic detail. | |
|
| fake news | `8` | Fake news |
|
| OK | `9` | OK |
|
|
|
## Intended uses & limitations |
|
|
|
English language only. This model is a demonstrator, not intended for commercial or production use. Use with care. |
|
|
|
### Framework versions |
|
|
|
- Transformers 4.40.2 |
|
- Pytorch 2.2.2+cu121 |
|
- Datasets 2.19.1 |
|
- Tokenizers 0.19.1 |
|
|