File size: 1,854 Bytes
586845b d803f8f 31ce833 c635a58 d803f8f 31ce833 751094a c5a27a6 751094a 29d7233 751094a 29d7233 11d1a6f 751094a c5a27a6 751094a c5a27a6 751094a c635a58 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
license: mit
datasets:
- stereoset
- crows_pairs
- wu981526092/MGSD
language:
- en
metrics:
- f1
- recall
- precision
- accuracy
---
# Token-Level Stereotype Classifier
The Token-Level Stereotype Classifier is a transformer-based model developed to detect and classify different types of stereotypes present in the text at the token level. It is designed to recognize stereotypical and anti-stereotypical stereotypes towards gender, race, profession, and religion. The model can help in developing applications aimed at mitigating stereotypical language use and promoting fairness and inclusivity in natural language processing tasks.
## Model Architecture
The model is built using the pretrained Distilbert model. It is fine-tuned on MGS Dataset for the task of token-level classification.
## Classes
The model identifies nine classes, including:
1. unrelated: The token does not indicate any stereotype.
2. stereotype_gender: The token indicates a gender stereotype.
3. anti-stereotype_gender: The token indicates an anti-gender stereotype.
4. stereotype_race: The token indicates a racial stereotype.
5. anti-stereotype_race: The token indicates an anti-racial stereotype.
6. stereotype_profession: The token indicates a professional stereotype.
7. anti-stereotype_profession: The token indicates an anti-professional stereotype.
8. stereotype_religion: The token indicates a religious stereotype.
9. anti-stereotype_religion: The token indicates an anti-religious stereotype.
## Usage
The model can be used as a part of the Hugging Face's pipeline for Named Entity Recognition (NER).
```python
from transformers import pipeline
nlp = pipeline("ner", model="wu981526092/Token-Level-Stereotype-Detector", tokenizer="wu981526092/Token-Level-Stereotype-Detector")
result = nlp("Text containing potential stereotype...")
print(result)
``` |