LangSAMP: Language-Script Aware Multilingual Pretraining
Paper
•
2409.18199
•
Published
•
1
Yihong Liu
yihongLiu
AI & ML interests
Natural Language Processing, Multilinguality
Recent Activity
authored
a paper
about 2 months ago
LangSAMP: Language-Script Aware Multilingual Pretraining
authored
a paper
about 2 months ago
How Transliterations Improve Crosslingual Alignment
Organizations
yihongLiu's activity
authored
2
papers
about 2 months ago
updated
a
model
3 months ago
authored
4
papers
3 months ago
OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining
Paper
•
2311.08849
•
Published
•
5
TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data
Paper
•
2405.09913
•
Published
Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment
Paper
•
2406.19759
•
Published
TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models
Paper
•
2401.06620
•
Published
liked
a
Space
7 months ago
liked
a
dataset
7 months ago
updated
9
models
7 months ago
yihongLiu/furina-with-transliteration-max
Fill-Mask
•
Updated
•
7
yihongLiu/furina-with-transliteration-min
Fill-Mask
•
Updated
•
4
yihongLiu/furina-with-transliteration-average
Fill-Mask
•
Updated
•
7
yihongLiu/glot500-with-transliteration-max
Fill-Mask
•
Updated
•
5
yihongLiu/glot500-with-transliteration-min
Fill-Mask
•
Updated
•
5
yihongLiu/glot500-with-transliteration-average
Fill-Mask
•
Updated
•
7
yihongLiu/xlm-r-with-transliteration-max
Fill-Mask
•
Updated
•
5
yihongLiu/xlm-r-with-transliteration-min
Fill-Mask
•
Updated
•
6
yihongLiu/xlm-r-with-transliteration-average
Fill-Mask
•
Updated
•
5
liked
a
Space
9 months ago
upvoted
a
paper
9 months ago