metadata

title: README
emoji: 📉
colorFrom: green
colorTo: purple
sdk: static
pinned: false

Welcome to the 🧨 `diffusers` organization!

diffusers is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI.

GitHub, Docs

In this organization, you can find some utilities and models we have made for you 🫶

🆕 SDXL Inpainting 🎨

We are training Inpainting specialist models for Stable Diffusion XL ✨. They are way better at inpainting and outpainting than the base-model, but are still experimental. Try it out and consider giving feedback! 🤗

Inpanting model	Demo
`stable-diffusion-xl-1.0-inpainting-0.1`	Spaces demo 🕹️

SDXL ControlNets

We are training ControlNets for Stable Diffusion XL ✨

Small sized ControlNets 🤏

We are experimenting with training smaller ControlNets that can still retain their control capabilities! This is the training script used. Please check the models released, and consider giving us feedback on our Discord server:

ControlNet	Size in fp16
`controlnet-canny-sdxl-1.0-small`	320MB
`controlnet-canny-sdxl-1.0-mid`	545MB
`controlnet-depth-sdxl-1.0-small`	320MB
`controlnet-depth-sdxl-1.0-mid`	545MB

Full sized ControlNets 💪

The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a ControlNet training script and guide here

ControlNet
`controlnet-canny-sdxl-1.0`
`controlnet-depth-sdxl-1.0`
`controlnet-zoe-depth-sdxl-1.0`

Utilities 🔧

More coming soon ✨