tafseer-nayeem
commited on
Commit
•
d52c82b
1
Parent(s):
a6b09a0
Update README.md
Browse files
README.md
CHANGED
@@ -129,4 +129,8 @@ If you use any of the resources or it's relevant to your work, please cite our [
|
|
129 |
pages = "4813--4836",
|
130 |
abstract = "Recent studies highlight the potential of large language models in creating educational tools for children, yet significant challenges remain in maintaining key child-specific properties such as linguistic nuances, cognitive needs, and safety standards. In this paper, we explore foundational steps toward the development of child-specific language models, emphasizing the necessity of high-quality pre-training data. We introduce a novel user-centric data collection pipeline that involves gathering and validating a corpus specifically written for and sometimes by children. Additionally, we propose a new training objective, Stratified Masking, which dynamically adjusts masking probabilities based on our domain-specific child language data, enabling models to prioritize vocabulary and concepts more suitable for children. Experimental evaluations demonstrate that our model excels in understanding lower grade-level text, maintains safety by avoiding stereotypes, and captures children{'}s unique preferences. Furthermore, we provide actionable insights for future research and development in child-specific language modeling.",
|
131 |
}
|
132 |
-
```
|
|
|
|
|
|
|
|
|
|
129 |
pages = "4813--4836",
|
130 |
abstract = "Recent studies highlight the potential of large language models in creating educational tools for children, yet significant challenges remain in maintaining key child-specific properties such as linguistic nuances, cognitive needs, and safety standards. In this paper, we explore foundational steps toward the development of child-specific language models, emphasizing the necessity of high-quality pre-training data. We introduce a novel user-centric data collection pipeline that involves gathering and validating a corpus specifically written for and sometimes by children. Additionally, we propose a new training objective, Stratified Masking, which dynamically adjusts masking probabilities based on our domain-specific child language data, enabling models to prioritize vocabulary and concepts more suitable for children. Experimental evaluations demonstrate that our model excels in understanding lower grade-level text, maintains safety by avoiding stereotypes, and captures children{'}s unique preferences. Furthermore, we provide actionable insights for future research and development in child-specific language modeling.",
|
131 |
}
|
132 |
+
```
|
133 |
+
|
134 |
+
## Contributors
|
135 |
+
- Mir Tafseer Nayeem (mnayeem@ualberta.ca)
|
136 |
+
- Davood Rafiei (drafiei@ualberta.ca)
|