| license: apache-2.0 | |
| datasets: | |
| - cerebras/SlimPajama-627B | |
| - bigcode/starcoderdata | |
| - mc4 | |
| language: | |
| - fi | |
| - en | |
| - da | |
| - sv | |
| - 'no' | |
| - nn | |
| - is | |
| # Viking 7B | |
| Viking 7B is a 7B parameter decoder-only transformer pretrained on Finnish, | |
| English, Swedish, Danish, Norwegian, Icelandic and code. It has been trained | |
| on 2 trillion tokens. Viking 7B is a fully open source model and is made available under the Apache 2.0 License. | |
| Please see [the upstream repository](https://huggingface.co/LumiOpen/Viking-7B) for more information. | |
| This GGML quantization was done with [akx/ggify](https://github.com/akx/ggify) with llama.cpp b2901 with a small modification to the conversion script to support the Viking tokenizer. |