File size: 709 Bytes
8fa3941 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: apache-2.0
datasets:
- cerebras/SlimPajama-627B
- bigcode/starcoderdata
- mc4
language:
- fi
- en
- da
- sv
- 'no'
- nn
- is
---
# Viking 7B
Viking 7B is a 7B parameter decoder-only transformer pretrained on Finnish,
English, Swedish, Danish, Norwegian, Icelandic and code. It has been trained
on 2 trillion tokens. Viking 7B is a fully open source model and is made available under the Apache 2.0 License.
Please see [the upstream repository](https://huggingface.co/LumiOpen/Viking-7B) for more information.
This GGML quantization was done with [akx/ggify](https://github.com/akx/ggify) with llama.cpp b2901 with a small modification to the conversion script to support the Viking tokenizer. |