HPLT

community

https://hplt-project.org/

hplt_eu

hplt-project

Activity Feed Request to join this org

AI & ML interests

Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing

Recent Activity

oepen authored a paper 8 days ago

The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective

ltgoslo new activity 14 days ago

HPLT/hplt_bert_base_ja:Adding `safetensors` variant of this model

ltgoslo new activity 14 days ago

HPLT/hplt_bert_base_fr:Adding `safetensors` variant of this model

View all activity

HPLT's activity

oepen

authored a paper 8 days ago

The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective

Paper • 2412.09460 • Published 12 days ago • 5

ltgoslo

in HPLT/hplt_bert_base_ja 14 days ago

Adding `safetensors` variant of this model

#2 opened about 1 month ago by

SFconvertbot

ltgoslo

in HPLT/hplt_bert_base_fr 14 days ago

Adding `safetensors` variant of this model

#1 opened about 1 month ago by

SFconvertbot

ltgoslo

in HPLT/hplt_bert_base_lv 14 days ago

Adding `safetensors` variant of this model

#1 opened 28 days ago by

SFconvertbot

ltgoslo

in HPLT/hplt_bert_base_ur 14 days ago

Adding `safetensors` variant of this model

#1 opened 15 days ago by

SFconvertbot

BramVanroy

posted an update 18 days ago

Post

435

In the spirit of "Better late than never", I've finally written a brief overview paper for GEITje 7B Ultra. Initially released 10 months ago (oops), but still reaching around 1300 monthly downloads across the HF ecosystem (not including ollama).

GEITje 7B Ultra: A Conversational Model for Dutch (2412.04092)

While the paper discusses the model a little bit, I especially wanted to write about the datasets, which to this day seem an important asset for Dutch LLM training (SFT and preference tuning). We have a long way to go for Dutch, but publishing transparent and reproducible artefacts seems an important step to me, alongside having open discussions about data, bias, architectures.

In that spirit, thanks are in order for the creation of GEITje 7B Ultra and all related datasets:

- Michiel Buisman and UWV for providing the means to create the datasets
- Flemish Supercomputer Center (VSC) for the compute
- The Hugging Face Fellows and rest of the team for their discussions and insights
- The Dutch NLP community, notably @Rijgersberg for building the base GEITje model and the fruitful discussions we've had

More to come, step by step!

BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208