ChocoLlama: Lessons Learned From Teaching Llamas Dutch
Paper
ā¢
2412.07633
ā¢
Published
AI & ML interests
None defined yet.
Recent Activity
View all activity
flair's activity
How to train NER model
1
#4 opened 6 days ago
by
amriteshbytesview
pdelobelleĀ
authored
a
paper
6 days ago
Post
1129
My latest project is the outcome of the last 2+ years working with TPUs from the amazing TPU Research Cloud (TRC) program and training Encoder-only LMs with the TensorFlow Model Garden library.
š Link: https://github.com/stefan-it/model-garden-lms
An overview of some features:
- Cheatsheet for setting-up a TPU VM Pod (with all necessary dependencies) to pretrain LMs with TF Model Garden
- Conversion scripts that convert TF Model Garden weights to Hugging Face Transformers-compatible models
- Supported architectures include BERT, BERT with Token Dropping and TEAMS
I also released BERT-based models pretrained on the great Hugging Face FineWeb and FineWeb-Edu datasets (10BT subset). With more to come!
š Model Hub Link: https://huggingface.co/model-garden-lms
If you find these resources useful, please give them a like!
Made from Bavarian Oberland with ā¤ļø and š„Ø.
š Link: https://github.com/stefan-it/model-garden-lms
An overview of some features:
- Cheatsheet for setting-up a TPU VM Pod (with all necessary dependencies) to pretrain LMs with TF Model Garden
- Conversion scripts that convert TF Model Garden weights to Hugging Face Transformers-compatible models
- Supported architectures include BERT, BERT with Token Dropping and TEAMS
I also released BERT-based models pretrained on the great Hugging Face FineWeb and FineWeb-Edu datasets (10BT subset). With more to come!
š Model Hub Link: https://huggingface.co/model-garden-lms
If you find these resources useful, please give them a like!
Made from Bavarian Oberland with ā¤ļø and š„Ø.
typo, urls and congrats on the strong model!
1
#1 opened 20 days ago
by
JanPf
pdelobelleĀ
updated
a
model
20 days ago
pdelobelleĀ
authored
a
paper
5 months ago
alanakbikĀ
updated
5
models
5 months ago
flair/ner-english
Token Classification
ā¢
Updated
ā¢
169k
ā¢
32
flair/ner-english-fast
Token Classification
ā¢
Updated
ā¢
1.12M
ā¢
20
flair/frame-english-fast
Token Classification
ā¢
Updated
ā¢
12
ā¢
1
flair/frame-english
Token Classification
ā¢
Updated
ā¢
165
ā¢
1
flair/ner-german-legal
Token Classification
ā¢
Updated
ā¢
605
ā¢
16
alanakbikĀ
updated
a
model
9 months ago
pdelobelleĀ
authored
5
papers
10 months ago
RobBERT: a Dutch RoBERTa-based Language Model
Paper
ā¢
2001.06286
ā¢
Published
ā¢
1
Dutch Humor Detection by Generating Negative Examples
Paper
ā¢
2010.13652
ā¢
Published
RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use
Paper
ā¢
2211.08192
ā¢
Published
ā¢
1
Measuring Shifts in Attitudes Towards COVID-19 Measures in Belgium Using Multilingual BERT
Paper
ā¢
2104.09947
ā¢
Published
Time to Take Emoji Seriously: They Vastly Improve Casual Conversational Models
Paper
ā¢
1910.13793
ā¢
Published
pdelobelleĀ
authored
a
paper
about 1 year ago
stefan-itĀ
updated
a
Space
about 1 year ago
stefan-itĀ
authored
a
paper
over 1 year ago