Hugging Face's logo
Guilherme Penedo's picture
90 16 19

Guilherme Penedo

guipenedo
Bowaleblessed's profile picture soul-tuner-786's profile picture nishantrastogi80's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a Space about 1 hour ago
lvwerra/distill-blog-template
updated a dataset about 5 hours ago
HuggingFaceFW/clean-wikipedia
updated a dataset about 5 hours ago
HuggingFaceFW/clean-wikipedia
View all activity

Organizations

Hugging Face's profile picture BigScience Data's profile picture HuggingFaceBR4's profile picture Hugging Face H4's profile picture Hugging Face Extreme-Scale's profile picture Hugging Face TB Research's profile picture Hugging Face Smol Cluster's profile picture Nanotron Research's profile picture HuggingFaceFW's profile picture Data Is Better Together's profile picture mlo-data-cleaning's profile picture Dev Mode Explorers's profile picture HuggingFaceFW-Dev's profile picture Hugging Face Science's profile picture ml-fw-prerelease's profile picture Open R1's profile picture todo's profile picture

guipenedo's activity

New activity in HuggingFaceFW/fineweb about 1 month ago

Downloading the 350BT sample uses 990GB of disk space

4
#57 opened about 2 months ago by
ddh0

Create Ffcc

1
#58 opened about 1 month ago by
Ricky23184
New activity in huggingface-legal/takedown-notices about 1 month ago

Update 2025/2025-01-22-Torstar.md
#4 opened about 1 month ago by
guipenedo
New activity in HuggingFaceFW/fineweb-edu about 2 months ago

New update returns a 500 server error using the datasets-server API

6
#18 opened 3 months ago by
jonna32
New activity in HuggingFaceFW/fineweb-2 about 2 months ago

Synthetic Data Generator

1
#5 opened 2 months ago by
kishorekashyap
New activity in HuggingFaceFW/fineweb-2 2 months ago

Cannot load with datasets

3
#4 opened 2 months ago by
mbanon
New activity in HuggingFaceFW/fineweb-edu 2 months ago

A lot of load errors after new update

14
#19 opened 2 months ago by
yzhangcs

Add "date" column to "default" subset
#20 opened 2 months ago by
lhoestq
New activity in HuggingFaceFW/fineweb 3 months ago

Simple exact deduplication removes 2/3 of data.

4
#49 opened 7 months ago by
egor-pakhomov

Torrent?

3
#4 opened 11 months ago by
emilss

Any plan to train models on larger subset of dataset?

1
#8 opened 11 months ago by
mrfakename

Are copyrighted works included in this dataset?

4
#9 opened 11 months ago by
umm-maybe

Reprocessing for a new language

14
#12 opened 11 months ago by
pere

Training configs for data ablation study

2
#14 opened 11 months ago by
jimmyhbx

tiny-fineweb

3
#19 opened 11 months ago by
3thn

Unsafe files

1
#25 opened 10 months ago by
alielfilali01

"Reproducing GPT-2 (124M) in llm.c in 90 minutes for $20" using fineweb by Karpathy
#28 opened 10 months ago by
clem

Regarding to the newly updated indexes(writen as deduplication issues)

5
#29 opened 9 months ago by
kimcando

Dedup

1
#32 opened 9 months ago by
shawnkx

Language subset

3
#33 opened 9 months ago by
talmor