Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,10 @@ __ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain
|
|
15 |
|
16 |
Mike Zhang, Rob van der Goot, and Barbara Plank. In ACL (2023).
|
17 |
|
|
|
|
|
|
|
|
|
18 |
If you use this work please cite the following:
|
19 |
|
20 |
```
|
|
|
15 |
|
16 |
Mike Zhang, Rob van der Goot, and Barbara Plank. In ACL (2023).
|
17 |
|
18 |
+
We introduce a language model called ESCOXLM-R, based on XLM-r (large), which uses domain-adaptive pre-training on the European Skills, Competences, Qualifications and Occupations
|
19 |
+
(ESCO) taxonomy, covering 27 languages. The pre-training objectives for ESCOXLM-R include dynamic masked language modeling and a novel additional objective for inducing multilingual taxonomical ESCO relations (see paper for more details).
|
20 |
+
We comprehensively evaluate the performance of ESCOXLM-R on 6 sequence labeling and 3 classification tasks in 4 languages and find that it achieves state-of-the-art results on 6 out of 9 datasets.
|
21 |
+
|
22 |
If you use this work please cite the following:
|
23 |
|
24 |
```
|