Models
Structural conditioning uses canny edge or depth detection to maintain precise control during image transformations. By preserving the original image's structure through edge or depth maps, users can make text-guided edits while keeping the core composition intact. This is particularly effective for retexturing images. We release four variations: two based on edge maps (full model and LoRA for FLUX.1 [dev]) and two based on depth maps (full model and LoRA for FLUX.1 [dev]).
| Name | HuggingFace repo | License | sha256sum |
|---|---|---|---|
FLUX.1 Canny [dev] |
https://huggingface.co/black-forest-labs/FLUX.1-Canny-dev | FLUX.1-dev Non-Commercial License | 996876670169591cb412b937fbd46ea14cbed6933aef17c48a2dcd9685c98cdb |
FLUX.1 Depth [dev] |
https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev | FLUX.1-dev Non-Commercial License | 41360d1662f44ca45bc1b665fe6387e91802f53911001630d970a4f8be8dac21 |
FLUX.1 Canny [dev] LoRA |
https://huggingface.co/black-forest-labs/FLUX.1-Canny-dev-lora | FLUX.1-dev Non-Commercial License | 8eaa21b9c43d5e7242844deb64b8cf22ae9010f813f955ca8c05f240b8a98f7e |
FLUX.1 Depth [dev] LoRA |
https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev-lora | FLUX.1-dev Non-Commercial License | 1938b38ea0fdd98080fa3e48beb2bedfbc7ad102d8b65e6614de704a46d8b907 |
FLUX.1 Canny [pro] |
Available in our API. | ||
FLUX.1 Depth [pro] |
Available in our API. |
Examples
Open-weights usage
The full model weights (`FLUX.1 Canny [dev], Flux.1 Depth [dev], FLUX.1 [dev], and the autoencoder) will be downloaded automatically from HuggingFace once you start one of the demos. To download them, you will need to be logged in, see here. The LoRA weights are not downloaded automatically, but can be downloaded manually here (Canny) and here (Depth). You may specify any manually downloaded weights via environment variables: (necessary for LoRAs):
export FLUX_DEV_DEPTH=<path_to_flux_dev_depth_sft_file>
export FLUX_DEV_CANNY=<path_to_flux_dev_canny_sft_file>
export FLUX_DEV_DEPTH_LORA=<path_to_flux_dev_depth_lora_sft_file>
export FLUX_DEV_CANNY_LORA=<path_to_flux_dev_canny_lora_sft_file>
export FLUX_REDUX=<path_to_flux_redux_sft_file>
export FLUX_SCHNELL=<path_to_flux_schnell_sft_file>
export FLUX_DEV=<path_to_flux_dev_sft_file>
export AE=<path_to_ae_sft_file>
For interactive sampling run
python -m src.flux.cli_control --loop --name <name>
where name is one of flux-dev-canny, flux-dev-depth, flux-dev-canny-lora, or flux-dev-depth-lora.