Hugging Face's logo

ml-fw-prerelease

Enterprise
community
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

SivilTaramΒ  authored a paper about 1 month ago
When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
SivilTaramΒ  authored a paper about 1 month ago
Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
SivilTaramΒ  authored a paper about 1 month ago
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models
View all activity

ml-fw-prerelease's activity

alielfilali01Β 
posted an update 12 days ago
view post
Post
3297
Unpopular opinion: Open Source takes courage to do !

Not everyone is brave enough to release what they have done (the way they've done it) to the wild to be judged !
It really requires a high level of "knowing wth are you doing" ! It's kind of a super power !

Cheers to the heroes here who see this!
Β·
alielfilali01Β 
posted an update 16 days ago
view post
Post
1473
Apparently i forgot to put this here !

Well, this is a bit late but consider given our recent blog a read if you are interested in Evaluation.

You don't have to be into Arabic NLP in order to read it, the main contribution we are introducing is a new evaluation measure for NLG. We made the fisrt application of this measure on Arabic for now and we will be working with colleagues from the community to expand it to other languages.

Blog:
Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard
https://huggingface.co/blog/leaderboard-3c3h-aragen

Space:
inceptionai/AraGen-Leaderboard

Give it a read and let me know your thoughts πŸ€—
BramVanroyΒ 
posted an update 19 days ago
view post
Post
438
In the spirit of "Better late than never", I've finally written a brief overview paper for GEITje 7B Ultra. Initially released 10 months ago (oops), but still reaching around 1300 monthly downloads across the HF ecosystem (not including ollama).

GEITje 7B Ultra: A Conversational Model for Dutch (2412.04092)

While the paper discusses the model a little bit, I especially wanted to write about the datasets, which to this day seem an important asset for Dutch LLM training (SFT and preference tuning). We have a long way to go for Dutch, but publishing transparent and reproducible artefacts seems an important step to me, alongside having open discussions about data, bias, architectures.

In that spirit, thanks are in order for the creation of GEITje 7B Ultra and all related datasets:

- Michiel Buisman and UWV for providing the means to create the datasets
- Flemish Supercomputer Center (VSC) for the compute
- The Hugging Face Fellows and rest of the team for their discussions and insights
- The Dutch NLP community, notably @Rijgersberg for building the base GEITje model and the fruitful discussions we've had

More to come, step by step!

BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208
SivilTaramΒ 
authored 3 papers about 1 month ago
alielfilali01Β 
posted an update about 1 month ago
view post
Post
2175
Unpopular opinion : o1-preview is more stupid than 4o and Qwen2.5-72B-Instruct in extremely underrated !
  • 2 replies
Β·
FakhraddinΒ 
authored a paper about 2 months ago
3ebdolaΒ 
authored a paper about 2 months ago
alielfilali01Β 
posted an update 2 months ago
view post
Post
1698
I feel like this incredible resource hasn't gotten the attention it deserves in the community!

@clefourrier and generally the HuggingFace evaluation team put together a fantastic guidebook covering a lot about π—˜π—©π—”π—Ÿπ—¨π—”π—§π—œπ—’π—‘ from basics to advanced tips.

link : https://github.com/huggingface/evaluation-guidebook

I haven’t finished it yet, but i'am enjoying every piece of it so far. Huge thanks @clefourrier and the team for this invaluable resource !
  • 3 replies
Β·
ouhenioΒ 
authored 2 papers 2 months ago
pereΒ 
authored 3 papers 2 months ago
RefalMachineΒ 
authored a paper 2 months ago
pereΒ 
authored a paper 2 months ago
SivilTaramΒ 
authored a paper 2 months ago
alielfilali01Β 
posted an update 3 months ago
view post
Post
1825
Why nobdoy is talking about the new training corpus released by MBZUAI today.

TxT360 is +15 Trillion tokens corpus outperforming FineWeb on several metrics. Ablation studies were done up to 1T tokens.

Read blog here : LLM360/TxT360
Dataset : LLM360/TxT360
  • 2 replies
Β·
alielfilali01Β 
posted an update 3 months ago
view post
Post
2568
Don't you think we should add a tag "Evaluation" for datasets that are meant to be benchmarks and not for training ?

At least, when someone is collecting a group of datasets from an organization or let's say the whole hub can filter based on that tag and avoid somehow contaminating their "training" data.