File size: 1,381 Bytes
eaccf59 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
# stable-diffusion-webui-non-prompt-travel (extensions)
Of course not only prompts! -- You shall also be able to travel through any other conditions. 😀
----
### ControlNet-Travel
Travel through ControlNet's control conditions like canny, depth, openpose, etc...
⚠Memory (not VRAM) usage grows linearly with sampling steps, and fusion layers count, this is its nature 😥
Quickstart instructions:
- prepare a folder of images, might be frames from a video
- check enble `sd-webui-controlnet`, set all parameters as you want, but it's ok to **leave the ref image box empty**
- reference images will be read from the image folder given in controlnet-travel :)
- find `ControlNet Travel` in the script dropdown, set all parameters again, specify your image folder path here
- click Generate button
Options:
- interp_meth: (categorical)
- `linear`: linear weighted sum, better for area-based annotaions like `depth`, `seg`
- `rife`: optical flow model (requires to install postprocess tools first), better for edge-base annotaions like `canny`, `openpose`
- skip_latent_fusion: (list of bool), experimental
- skip some latent layers fusion for saving memory, but might get wierd results 🤔
- ℹ in my experiences, the `mid` and `in` blocks are more safe to skip
- save_rife: (bool), save the rife interpolated condtion images
----
by Armit
2023/04/12
|