How we leveraged distilabel to create an Argilla 2.0 Chatbot
•
32
Agustín Piqueres Lajarín
plaguss
AI & ML interests
None yet
Recent Activity
updated
a dataset
about 11 hours ago
HuggingFaceH4/numina-deepseek-r1-qwen-7b
liked
a model
about 11 hours ago
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
published
a dataset
about 11 hours ago
HuggingFaceH4/numina-deepseek-r1-qwen-7b
Articles
Organizations
plaguss's activity
updated
a
dataset
about 11 hours ago
liked
a
model
about 11 hours ago
published
a
dataset
about 11 hours ago
liked
a
model
about 11 hours ago
reacted to
lewtun's
post with 🚀🔥
about 13 hours ago
Post
896
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
Follow along: https://github.com/huggingface/open-r1
🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
Follow along: https://github.com/huggingface/open-r1
updated
a
dataset
about 14 hours ago
published
a
dataset
about 14 hours ago
updated
a
dataset
1 day ago
published
a
dataset
1 day ago
updated
a
dataset
4 days ago
published
a
dataset
4 days ago
updated
a
dataset
5 days ago
published
a
dataset
5 days ago
updated
a
dataset
6 days ago
published
a
dataset
6 days ago
upvoted
a
paper
8 days ago
updated
a
dataset
11 days ago
published
a
dataset
11 days ago
updated
a
dataset
11 days ago