Comfy-Org/Wan_2.1_ComfyUI_repackaged
Updated
•
113
Will Brooks
TornButter
AI & ML interests
None yet
Recent Activity
liked
a model
2 days ago
Comfy-Org/Wan_2.1_ComfyUI_repackaged
liked
a model
2 days ago
Kijai/WanVideo_comfy
liked
a model
2 days ago
city96/Wan2.1-T2V-14B-gguf
Organizations
None yet
TornButter's activity
liked
5
models
2 days ago
liked
a
Space
2 days ago
liked
a
model
2 days ago
liked
a
model
8 days ago
liked
2
models
9 days ago
liked
a
model
15 days ago
liked
a
model
24 days ago
liked
a
Space
27 days ago
liked
a
model
29 days ago
liked
3
models
about 1 month ago
reacted to
MoritzLaurer's
post with 🔥
about 2 months ago
Post
1723
The TRL v0.13 release is 🔥! My highlight are the new process reward trainer to train models similar to o1 and tool call support:
🧠 Process reward trainer: Enables training of Process-supervised Reward Models (PRMs), which reward the quality of intermediate steps, promoting structured reasoning. Perfect for tasks like stepwise reasoning.
🔀 Model merging: A new callback leverages mergekit to merge models during training, improving performance by blending reference and policy models - optionally pushing merged models to the Hugging Face Hub.
🛠️ Tool call support: TRL preprocessing now supports tool integration, laying the groundwork for agent fine-tuning with examples like dynamic temperature fetching in prompts.
⚖️ Mixture of judges: The new AllTrueJudge combines decisions from multiple binary judges for more nuanced evaluation.
Read the release notes and other resources here 👇
Release: https://github.com/huggingface/trl/releases/tag/v0.13.0
Mergekit: https://github.com/arcee-ai/mergekit
Mixture of judges paper: The Perfect Blend: Redefining RLHF with Mixture of Judges (2409.20370)
🧠 Process reward trainer: Enables training of Process-supervised Reward Models (PRMs), which reward the quality of intermediate steps, promoting structured reasoning. Perfect for tasks like stepwise reasoning.
🔀 Model merging: A new callback leverages mergekit to merge models during training, improving performance by blending reference and policy models - optionally pushing merged models to the Hugging Face Hub.
🛠️ Tool call support: TRL preprocessing now supports tool integration, laying the groundwork for agent fine-tuning with examples like dynamic temperature fetching in prompts.
⚖️ Mixture of judges: The new AllTrueJudge combines decisions from multiple binary judges for more nuanced evaluation.
Read the release notes and other resources here 👇
Release: https://github.com/huggingface/trl/releases/tag/v0.13.0
Mergekit: https://github.com/arcee-ai/mergekit
Mixture of judges paper: The Perfect Blend: Redefining RLHF with Mixture of Judges (2409.20370)
liked
2
models
about 2 months ago
