laurentiubp commited on
Commit
bb23b88
·
verified ·
1 Parent(s): 4c294d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ short_description: CataLlama models official page
14
 
15
  CataLlama was trained on roughly **445 million new tokens** in three separate stages:
16
 
17
- - **Language engancement** with raw text - we could also call this "continued pre-training" at a very small scale.
18
  - **Supervised fine-tuning** on instructions consisting of 70% Catalan Language and 30% English Language.
19
  - **DPO fine-tuning** on preferences consisting of 70% Catalan language and 30% English Language.
20
 
 
14
 
15
  CataLlama was trained on roughly **445 million new tokens** in three separate stages:
16
 
17
+ - **Language enhancement** with raw text - we could also call this "continued pre-training" at a very small scale.
18
  - **Supervised fine-tuning** on instructions consisting of 70% Catalan Language and 30% English Language.
19
  - **DPO fine-tuning** on preferences consisting of 70% Catalan language and 30% English Language.
20