Hugging Face's logo
Jean B's picture
1

Jean B

jbegaint
·
https://jbegaint.fr

AI & ML interests

None yet

Recent Activity

upvoted a paper 9 days ago
TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot Learning
reacted to rwightman's post with 🚀 22 days ago
There's a new `timm` release, v 1.0.12, with a focus on optimizers. The optimizer factory has been refactored, there's now a `timm.optim.list_optimizers()` and new way to register optimizers and their attributes. As always you can use an `timm` optimizer like a `torch` one, just replace `torch.optim` with `timm.optim` New optimizers include: * AdafactorBigVision - `adfactorbv` * ADOPT - `adopt` / `adoptw` (decoupled decay) * MARS - `mars` * LaProp - `laprop` * Cautious Optimizers - a modification to all of the above, prefix with `c` as well as `cadamw`, `cnadamw`, `csgdw`, `clamb`, `crmsproptf` I shared some caution comparisons in this model repo: https://huggingface.co/rwightman/timm-optim-caution For details, references, see the code: https://github.com/huggingface/pytorch-image-models/tree/main/timm/optim
View all activity

Organizations

Apple's profile picture

jbegaint's activity

upvoted a paper 9 days ago
reacted to rwightman's post with 🚀 22 days ago
view post
Post
1313
There's a new timm release, v 1.0.12, with a focus on optimizers. The optimizer factory has been refactored, there's now a timm.optim.list_optimizers() and new way to register optimizers and their attributes. As always you can use an timm optimizer like a torch one, just replace torch.optim with timm.optim

New optimizers include:
* AdafactorBigVision - adfactorbv
* ADOPT - adopt / adoptw (decoupled decay)
* MARS - mars
* LaProp - laprop
* Cautious Optimizers - a modification to all of the above, prefix with c as well as cadamw, cnadamw, csgdw, clamb, crmsproptf

I shared some caution comparisons in this model repo: rwightman/timm-optim-caution

For details, references, see the code: https://github.com/huggingface/pytorch-image-models/tree/main/timm/optim

  • 3 replies
·