Safetensors
English
Telugu
llama
KobayashiKanna01 commited on
Commit
4d8a865
1 Parent(s): c95577d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -19,4 +19,30 @@ We use the **Telugu texts** in CulturaX and **English texts** in RedPajama with
19
  * batch size: 1M (2K*512)
20
  * lr scheduler: cosine
21
  * min lr: 1e-6
22
- * lr decay iters: 10240
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  * batch size: 1M (2K*512)
20
  * lr scheduler: cosine
21
  * min lr: 1e-6
22
+ * lr decay iters: 10240
23
+
24
+ ## Citation
25
+ If you find this model is useful in your work, please cite it with:
26
+ ```
27
+ @inproceedings{tao-etal-2024-unlocking,
28
+ title = "Unlocking the Potential of Model Merging for Low-Resource Languages",
29
+ author = "Tao, Mingxu and
30
+ Zhang, Chen and
31
+ Huang, Quzhe and
32
+ Ma, Tianyao and
33
+ Huang, Songfang and
34
+ Zhao, Dongyan and
35
+ Feng, Yansong",
36
+ editor = "Al-Onaizan, Yaser and
37
+ Bansal, Mohit and
38
+ Chen, Yun-Nung",
39
+ booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
40
+ month = nov,
41
+ year = "2024",
42
+ address = "Miami, Florida, USA",
43
+ publisher = "Association for Computational Linguistics",
44
+ url = "https://aclanthology.org/2024.findings-emnlp.508",
45
+ doi = "10.18653/v1/2024.findings-emnlp.508",
46
+ pages = "8705--8720"
47
+ }
48
+ ```