File size: 2,188 Bytes
0bf8dc4 584dd9a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
datasets:
- smilegate-ai/kor_unsmile
- jeanlee/kmhas_korean_hate_speech
language:
- ko
---
# K-urse_Detection_with_BERT
 
## Overview
**K-urse_Detection_with_BERT** : Korean Cursing expression Detection with fine-tuned klue_BERT
This is the KWU "text mining" output for the first semester of 2023.
See Project Overview Here! : [Notion(Korean)](https://www.notion.so/tolerblanc/4d70c776b3f74dbe8e03a38ccda27fbb?pvs=4)
See this model on GitHub : [Link](https://github.com/Tolerblanc/K-urse_Detection_with_BERT)
## Evaluation
- Comparison Model is [here](https://github.com/JminJ/Bad_text_classifier)
- Used [2runo's Curse-detection-data](https://github.com/2runo/Curse-detection-data)
| Model/Metric | Accuracy | Precision | Recall | F1 Score |
| --- | --- | --- | --- | --- |
| Comparison(Electra base) | 0.81 | 0.69 | **0.87** | **0.77** |
| klue-BERT base(Our best result) | **0.83** | **0.76**** | 0.75 | 0.75 |
- Used Youtube Comments
| Model/Metric | Accuracy | Precision | Recall | F1 Score |
| --- | --- | --- | --- | --- |
| Comparison(Electra base) | 0.77 | 0.52 | **0.90** | 0.66 |
| klue-BERT base(Our best result) | **0.89** | **0.75** | 0.80 | **0.78** |
## Demo with HuggingFace's Space 🤗
Try Demo Here! [Go to HuggingFace Space](https://huggingface.co/datasets/Tolerblanc/Demo_Kurse_detection)
## Reference
- Smilegate-AI's Korean Unsmile Dataset : [Link](https://huggingface.co/datasets/smilegate-ai/kor_unsmile)
- JeanLee's K-MHaS Dataset and Paper : [Link](https://huggingface.co/datasets/jeanlee/kmhas_korean_hate_speech)
- KLUE(Korean Language Understanding Evaluation) BERT : [Link](https://github.com/KLUE-benchmark/KLUE)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding : [Link](https://arxiv.org/abs/1810.04805)
- 2runo's Curse Detection Dataset : [Link](https://github.com/2runo/Curse-detection-data)
- JminJ's Bad Text Classifier : [Link](https://github.com/JminJ/Bad_text_classifier)
|