2.28k
The Ultra-Scale Playbook
🌌
The ultimate guide to training LLM on large GPU Clusters
Alberto Cetoli PRO
fractalego
AI & ML interests
Entity/relation extraction, Q&A, Summarisation
Recent Activity
reacted
to
BrigitteTousi's
post
with 🔥
6 days ago
LeRobot goes to driving school! 🚗🚗🚗
Hugging Face just announced a new collab with Yaak to bring the largest open-source self-driving dataset to LeRobot!
Major kudos to HF's @cadene, as well as @sandhawalia, @Shnissen and the Yaak team!
Check out the blog post here: https://huggingface.co/blog/lerobot-goes-to-driving-school
reacted
to
BrigitteTousi's
post
with 🚀
6 days ago
LeRobot goes to driving school! 🚗🚗🚗
Hugging Face just announced a new collab with Yaak to bring the largest open-source self-driving dataset to LeRobot!
Major kudos to HF's @cadene, as well as @sandhawalia, @Shnissen and the Yaak team!
Check out the blog post here: https://huggingface.co/blog/lerobot-goes-to-driving-school
reacted
to
csabakecskemeti's
post
with 🔥
16 days ago
Testing Training on AMD/ROCm the first time!
I've got my hands on an AMD Instinct MI100. It's about the same price used as a V100 but on paper has more TOPS (V100 14TOPS vs MI100 23TOPS) also the HBM has faster clock so the memory bandwidth is 1.2TB/s.
For quantized inference it's a beast (MI50 was also surprisingly fast)
For LORA training with this quick test I could not make the bnb config works so I'm running the FT on the fill size model.
Will share all the install, setup and setting I've learned in a blog post, together with the cooling shroud 3D design.
Organizations
fractalego's activity
liked
a
Space
26 days ago
liked
a
model
29 days ago
liked
a
dataset
about 1 month ago
liked
3
models
about 1 month ago
liked
a
dataset
2 months ago
liked
a
model
2 months ago
liked
2
datasets
2 months ago
liked
a
model
3 months ago
liked
a
model
4 months ago
liked
2
datasets
4 months ago
liked
a
dataset
5 months ago
liked
a
model
5 months ago
liked
a
dataset
5 months ago
liked
a
model
5 months ago
liked
2
models
6 months ago
