|
--- |
|
language: no |
|
license: CC-BY 4.0 |
|
tags: |
|
- norwegian |
|
- bert |
|
thumbnail: nblogo_3.png |
|
pipeline_tag: fill-mask |
|
widget: |
|
- text: "På biblioteket kan du låne en [MASK]." |
|
--- |
|
|
|
- **Release 1.0beta** (April 29, 2021) |
|
|
|
|
|
# NB-BERT-large (beta) |
|
|
|
## Description |
|
|
|
NB-BERT-large is a general BERT-large model built on the large digital collection at the National Library of Norway. |
|
|
|
This model is trained from scratch on a wide variety of Norwegian text (both bokmål and nynorsk) from the last 200 years using a monolingual Norwegian vocabulary. |
|
|
|
## Intended use & limitations |
|
|
|
The 1.0 version of the model is general, and should be fine-tuned for any particular use. Some fine-tuning sets may be found on Github, see |
|
|
|
* https://github.com/NBAiLab/notram |
|
|
|
## Training data |
|
|
|
The model is trained on a wide variety of text. The training set is described on |
|
|
|
* https://github.com/NBAiLab/notram |
|
|
|
## More information |
|
|
|
For more information on the model, see |
|
|
|
https://github.com/NBAiLab/notram |
