| language: | |
| - sq | |
| - en | |
| tags: | |
| - translation | |
| license: cc-by-4.0 | |
| ### Translation model for sq-en OPUS_HPLT v1.0 | |
| This repository contains the model weights for translation models trained with Marian for HPLT project. For usage instructions, evaluation scripts, and inference scripts, please refer to the [HPLT-MT-Models v1.0](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0) GitHub repository. | |
| * Source language: sq | |
| * Target language: en | |
| * Dataset: All of OPUS including HPLT | |
| * Model: transformer-base | |
| * Tokenizer: SentencePiece (Unigram) | |
| * Cleaning: We use OpusCleaner for cleaning the corpus. Details about rules used can be found in the filter files in [Github](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0/data/en-sq/raw/v2) | |
| To run inference with Marian, refer to the [Inference/Decoding/Translation](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0#inferencedecodingtranslation) section of our GitHub repository. | |
| ## Benchmarks | |
| | testset | BLEU | chr-F | COMET-22 | | |
| | -------------------------------------- | ---- | ----- | ----- | | |
| | flores200 | 37.8 | 61.9 | 0.8685 | | |
| | ntrex | 39.1 | 61.8 | 0.868 | | |