File size: 2,181 Bytes
c674250
 
 
 
de3bd8b
c674250
 
 
b18a8ff
c674250
0b19891
02f50a9
180fb41
 
c674250
 
de3bd8b
c674250
 
de3bd8b
 
 
 
 
 
 
 
 
 
 
 
c674250
de3bd8b
c674250
d6d2d08
c674250
 
 
 
 
 
 
ac01fd9
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
license: apache-2.0
base_model: cross-encoder/nli-deberta-v3-base
model-index:
- name: Komainu
  results: []
---

# Daijobu.ai - Komainu - Content Moderator

![Komainu Content Moderator](komainu.png)

Model created by [Daijobu.ai](https://daijobu.ai). Daijobu.ai drives your business AI transformation. [Learn More](https://daijobu.ai).

## Model description

This model can identify 9 types of contents to be moderated.


| Category | Output | Definition |
| -------- | ----- | ---------- |
| sexual   | `0`   | Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness). |
| hate     | `1`   | Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste. |
| violence | `2`   | Content that promotes or glorifies violence or celebrates the suffering or humiliation of others. |
| harassment       | `3`   | Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur. |
| self-harm        | `4`   | Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders. |
| sexual/minors    | `5`   | Sexual content that includes an individual who is under 18 years old. |
| hate/threatening | `6`   | Hateful content that also includes violence or serious harm towards the targeted group. |
| violence/graphic | `7`   | Violent content that depicts death, violence, or serious physical injury in extreme graphic detail. |
| fake news        | `8`   | Fake news
| OK | `9` | OK

## Intended uses & limitations

English language only. This model is a demonstrator, not intended for commercial or production use. Use with care.

### Framework versions

- Transformers 4.40.2
- Pytorch 2.2.2+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1

### Credits

This model is a fine-tuned version of [cross-encoder/nli-deberta-v3-base](https://huggingface.co/cross-encoder/nli-deberta-v3-base) on [Daijobu.ai's content moderation dataset](https://huggingface.co/datasets/DaijobuAI/moderation_dataset).