BigScience Data

non-profit

https://bigscience.huggingface.co

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

giadap authored a paper 9 days ago

Can AI be Consentful?

thomwolf authored a paper 16 days ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

lvwerra authored a paper 16 days ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

View all activity

bigscience-data 's Spaces 12

Document Sizes

Display document size plots

Process Pipeline Visualizer

Corpus Map

Display a treemap of languages and datasets

Filter Values Distributions

Bigscience Corpus

Roots Search Tool

Search through ROOTS corpus using queries

Roots Search Tool - dev tier

Pyserini

Bloom Tokenizer Multilinguality

Display Bokeh plot

Token Explorer

Bloom Tokens

Display a Bokeh plot

Bigscience Tokenizer