VideoModelStudio / docs /finetrainers /documentation_optimizers.md
jbilcke-hf's picture
jbilcke-hf HF staff
upgrading our code to support the new finetrainers
d464085

Optimizers

The following optimizers are supported:

  • torch:
    • Adam
    • AdamW
  • bitsandbytes:
    • Adam
    • AdamW
    • Adam8Bit
    • AdamW8Bit

Not all optimizers have been tested with all models/parallel settings. They may or may not work, but this will gradually improve over time.