| Qwen2VL-Flux was released a while ago. It comes with a standalone ControlNet model that works with Flux Dev. Fully compatible with ComfyUI. | |
| I works well with Depth and Canny and kinda works with Tile and Realistic Lineart. You can also combine Depth and Canny. | |
| Usually works well with strength 0.6-0.8 depending on the image. You might need to run Flux at FP8 to avoid OOM. | |
| There's a sample workflow in this repo that you can try on ComfyUI. | |
| The original project can be found here: | |
| https://huggingface.co/Djrango/Qwen2vl-Flux | |
| The model in my repo is simply the weights from https://huggingface.co/Djrango/Qwen2vl-Flux/tree/main/controlnet | |
| All credit belongs to the original creator of the model Pengqi Lu. | |
| --- | |
| license: other | |
| license_name: flux-1-dev-non-commercial-license | |
| license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md | |
| --- | |