bhavitvyamalik commited on
Commit
70e373a
1 Parent(s): 5f57ca8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - translation
4
+ license: cc-by-4.0
5
+ ---
6
+
7
+ ### Translation model for en-zh_hant OPUS_HPLT v1.0
8
+
9
+ This repository contains the model weights for translation models trained with Marian for HPLT project. For usage instructions, evaluation scripts, and inference scripts, please refer to the [HPLT-MT-Models v1.0](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0) GitHub repository.
10
+
11
+ * Source language: en
12
+ * Target language: zh_hant
13
+ * Dataset: All of OPUS including HPLT
14
+ * Model: transformer-base
15
+ * Tokenizer: SentencePiece (Unigram)
16
+ * Cleaning: We use OpusCleaner for cleaning the corpus. Details about rules used can be found in the filter files in [Github](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0/data/en-zh_hant/raw/v2)
17
+
18
+ To run inference with Marian, refer to the [Inference/Decoding/Translation](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0#inferencedecodingtranslation) section of our GitHub repository.
19
+
20
+
21
+ ## Benchmarks
22
+
23
+ | testset | BLEU | chr-F | comet |
24
+ | -------------------------------------- | ---- | ----- | ----- |
25
+ | flores200 | 23.4 | 18.5 | 0.8364 |
26
+ | ntrex | 19.6 | 20.4 | 0.7934 |