Update README.md
Browse files
README.md
CHANGED
@@ -52,9 +52,10 @@ Ikväll blir det grillat och det ser jag fram emot!"
|
|
52 |
```
|
53 |
## Training information
|
54 |
|
55 |
-
`AI-Sweden-Models/Llama-3-8B` is a continuation of the pretraining process from `meta-llama/Meta-Llama-3-8B`.
|
|
|
56 |
|
57 |
-
|
58 |
|
59 |
## Benchmarks
|
60 |
|
|
|
52 |
```
|
53 |
## Training information
|
54 |
|
55 |
+
`AI-Sweden-Models/Llama-3-8B` is a continuation of the pretraining process from `meta-llama/Meta-Llama-3-8B`.
|
56 |
+
It was trained on a subset from [The Nordic Pile](https://arxiv.org/abs/2303.17183) containing Swedish, Norwegian and Danish.
|
57 |
|
58 |
+
The dataset consists of 227 105 079 296 tokens.
|
59 |
|
60 |
## Benchmarks
|
61 |
|