Compiled transformer

#12
by cbensimon HF Staff - opened

Use PyTorch Ahead-Of-Time Compilation to speed-up denoising loop.

With the first demo example:

  • Before: 28s
  • After: 19s

Live demo here: https://huggingface.co/spaces/cbensimon/FLUX.1-Kontext-Dev

Mostly inspired by https://github.com/huggingface/flux-fast

cbensimon changed pull request status to open
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment