File size: 3,388 Bytes
61259cf
 
 
f25ec6a
 
 
 
 
 
 
 
 
61259cf
 
6f1153d
61259cf
 
 
 
 
a025de7
61259cf
 
 
 
 
 
 
 
 
 
a025de7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
---
# For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=1
# Doc / guide: https://huggingface.co/docs/hub/model-cards
language: ar
widget:
 - text: "وين المحطة؟"
 - text: "شنو رقم الرحلة؟"
 - text: "ازيك يا جومانا وحشاني"
 - text: "شحوالك يا جومانا توحشتك"
 - text: "كيفك يا جومانا اشتقتلك"
 - text: "كيفك جومانا اشتقتلك كتير"
 - text: "كيفك حالك يا جمانه مشتاقلك"
---

# Model Card for ADI-NADI-2023

[![GitHub](https://img.shields.io/badge/💻-GitHub%20-black.svg)](https://github.com/AMR-KELEG/ADI-under-scrutiny)

<!-- Provide a quick summary of what the model is/does. -->

A BERT-based model fine-tuned to perform single-label Arabic Dialect Identification (ADI). The model was used in the following paper: [Arabic Dialect Identification under Scrutiny: Limitations of Single-label Classification](https://aclanthology.org/2023.arabicnlp-1.31/)
### Model Description

<!-- Provide a longer summary of what this model is. -->

<!-- - **Developed by:** Amr Keleg -->
- **Model type:** A Dialect Identification model fine-tuned on [NADI 2023](https://nadi.dlnlp.ai/)'s training data.
- **Language(s) (NLP):** Arabic.
<!--- **License:** [More Information Needed] -->
- **Finetuned from model :** [MarBERT](https://huggingface.co/UBC-NLP/MARBERT)


### Citation

If you find the model useful, please cite the following [respective paper](https://aclanthology.org/2023.arabicnlp-1.31/):
```
@inproceedings{keleg-magdy-2023-arabic,
    title = "{A}rabic Dialect Identification under Scrutiny: Limitations of Single-label Classification",
    author = "Keleg, Amr  and
      Magdy, Walid",
    editor = "Sawaf, Hassan  and
      El-Beltagy, Samhaa  and
      Zaghouani, Wajdi  and
      Magdy, Walid  and
      Abdelali, Ahmed  and
      Tomeh, Nadi  and
      Abu Farha, Ibrahim  and
      Habash, Nizar  and
      Khalifa, Salam  and
      Keleg, Amr  and
      Haddad, Hatem  and
      Zitouni, Imed  and
      Mrini, Khalil  and
      Almatham, Rawan",
    booktitle = "Proceedings of ArabicNLP 2023",
    month = dec,
    year = "2023",
    address = "Singapore (Hybrid)",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.arabicnlp-1.31",
    doi = "10.18653/v1/2023.arabicnlp-1.31",
    pages = "385--398",
    abstract = "Automatic Arabic Dialect Identification (ADI) of text has gained great popularity since it was introduced in the early 2010s. Multiple datasets were developed, and yearly shared tasks have been running since 2018. However, ADI systems are reported to fail in distinguishing between the micro-dialects of Arabic. We argue that the currently adopted framing of the ADI task as a single-label classification problem is one of the main reasons for that. We highlight the limitation of the incompleteness of the Dialect labels and demonstrate how it impacts the evaluation of ADI systems. A manual error analysis for the predictions of an ADI, performed by 7 native speakers of different Arabic dialects, revealed that $\approx$ 67{\%} of the validated errors are not true errors. Consequently, we propose framing ADI as a multi-label classification task and give recommendations for designing new ADI datasets.",
}
```