bhavitvyamalik commited on
Commit
cd3fcda
1 Parent(s): 242299a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ca
4
+ - en
5
+ tags:
6
+ - translation
7
+ license: cc-by-4.0
8
+ ---
9
+
10
+ ### Translation model for ca-en HPLT v1.0
11
+
12
+ This repository contains the model weights for translation models trained with Marian for HPLT project. For usage instructions, evaluation scripts, and inference scripts, please refer to the [HPLT-MT-Models v1.0](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0) GitHub repository.
13
+
14
+ * Source language: ca
15
+ * Target language: en
16
+ * Dataset: HPLT only
17
+ * Model: transformer-base
18
+ * Tokenizer: SentencePiece (Unigram)
19
+ * Cleaning: We use OpusCleaner for cleaning the corpus. Details about rules used can be found in the filter files in [Github](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0/data/ca-en/raw/v0)
20
+
21
+ To run inference with Marian, refer to the [Inference/Decoding/Translation](https://github.com/hplt-project/HPLT-MT-Models/tree/main/v1.0#inferencedecodingtranslation) section of our GitHub repository.
22
+
23
+
24
+ ## Benchmarks
25
+
26
+ | testset | BLEU | chr-F | comet |
27
+ | -------------------------------------- | ---- | ----- | ----- |
28
+ | flores200 | 41.0 | 64.4 | 0.8955 |
29
+ | ntrex | 31.3 | 57.7 | 0.8757 |