jjzha commited on
Commit
7ffea8f
1 Parent(s): b114c00

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -15,6 +15,10 @@ __ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain
15
 
16
  Mike Zhang, Rob van der Goot, and Barbara Plank. In ACL (2023).
17
 
 
 
 
 
18
  If you use this work please cite the following:
19
 
20
  ```
 
15
 
16
  Mike Zhang, Rob van der Goot, and Barbara Plank. In ACL (2023).
17
 
18
+ We introduce a language model called ESCOXLM-R, based on XLM-r (large), which uses domain-adaptive pre-training on the European Skills, Competences, Qualifications and Occupations
19
+ (ESCO) taxonomy, covering 27 languages. The pre-training objectives for ESCOXLM-R include dynamic masked language modeling and a novel additional objective for inducing multilingual taxonomical ESCO relations (see paper for more details).
20
+ We comprehensively evaluate the performance of ESCOXLM-R on 6 sequence labeling and 3 classification tasks in 4 languages and find that it achieves state-of-the-art results on 6 out of 9 datasets.
21
+
22
  If you use this work please cite the following:
23
 
24
  ```