metadata
license: apache-2.0
base_model: cross-encoder/nli-deberta-v3-base
model-index:
- name: Komainu
results: []
Daijobu.ai - Komainu - Content Moderator
Model created by Daijobu.ai. Daijobu.ai drives your business AI transformation. Learn More.
Model description
This model can identify 9 types of contents to be moderated.
Category | Output | Definition |
---|---|---|
sexual | 0 |
Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness). |
hate | 1 |
Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste. |
violence | 2 |
Content that promotes or glorifies violence or celebrates the suffering or humiliation of others. |
harassment | 3 |
Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur. |
self-harm | 4 |
Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders. |
sexual/minors | 5 |
Sexual content that includes an individual who is under 18 years old. |
hate/threatening | 6 |
Hateful content that also includes violence or serious harm towards the targeted group. |
violence/graphic | 7 |
Violent content that depicts death, violence, or serious physical injury in extreme graphic detail. |
fake news | 8 |
Fake news |
OK | 9 |
OK |
Intended uses & limitations
English language only. This model is a demonstrator, not intended for commercial or production use. Use with care.
Framework versions
- Transformers 4.40.2
- Pytorch 2.2.2+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1
Credits
This model is a fine-tuned version of cross-encoder/nli-deberta-v3-base on Daijobu.ai's content moderation dataset.