bhavitvyamalik commited on
Commit
3d837cb
1 Parent(s): 739d6eb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - hi
5
+ tags:
6
+ - translation
7
+ license: cc-by-4.0
8
+ ---
9
+
10
+ ### Translation model for en-hi OPUS_HPLT v1.0
11
+
12
+ This repository contains the model weights for translation models trained with Marian for HPLT project. For usage instructions, evaluation scripts, and inference scripts, please refer to the [HPLT-MT-Models v1.0](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0) GitHub repository.
13
+
14
+ * Source language: en
15
+ * Target language: hi
16
+ * Dataset: All of OPUS including HPLT
17
+ * Model: transformer-base
18
+ * Tokenizer: SentencePiece (Unigram)
19
+ * Cleaning: We use OpusCleaner for cleaning the corpus. Details about rules used can be found in the filter files in [Github](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0/data/en-hi/raw/v2)
20
+
21
+ To run inference with Marian, refer to the [Inference/Decoding/Translation](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0#inferencedecodingtranslation) section of our GitHub repository.
22
+
23
+
24
+ ## Benchmarks
25
+
26
+ | testset | BLEU | chr-F | comet |
27
+ | -------------------------------------- | ---- | ----- | ----- |
28
+ | flores200 | 34.5 | 57.1 | 0.8385 |
29
+ | ntrex | 27.7 | 50.9 | 0.8075 |