timpal0l commited on
Commit
a5b5284
1 Parent(s): 8c552ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -52,9 +52,10 @@ Ikväll blir det grillat och det ser jag fram emot!"
52
  ```
53
  ## Training information
54
 
55
- `AI-Sweden-Models/Llama-3-8B` is a continuation of the pretraining process from `meta-llama/Meta-Llama-3-8B`. It was trained on a subset from [The Nordic Pile](https://arxiv.org/abs/2303.17183) containing Swedish, Norwegian and Danish.
 
56
 
57
- A total of 92 A100 GPUs were used, and roughly 250GB of data was processed.
58
 
59
  ## Benchmarks
60
 
 
52
  ```
53
  ## Training information
54
 
55
+ `AI-Sweden-Models/Llama-3-8B` is a continuation of the pretraining process from `meta-llama/Meta-Llama-3-8B`.
56
+ It was trained on a subset from [The Nordic Pile](https://arxiv.org/abs/2303.17183) containing Swedish, Norwegian and Danish.
57
 
58
+ The dataset consists of 227 105 079 296 tokens.
59
 
60
  ## Benchmarks
61