Spaces:
Running
Running
File size: 3,429 Bytes
5d114a6 d63dc1f 915a562 0bae41a 915a562 d7a8807 d63dc1f 094a519 1d920cb 094a519 d7a8807 d4ade35 d7a8807 eb1e6c1 d7a8807 eb1e6c1 4c99e2d d7a8807 d63dc1f d7a8807 eb1e6c1 d7a8807 d63dc1f 0f87770 d7a8807 eb1e6c1 d63dc1f d7a8807 d63dc1f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 |
---
title: README
emoji: 📉
colorFrom: green
colorTo: purple
sdk: static
pinned: false
---
# Welcome to the 🧨 `diffusers` organization!
`diffusers` is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI.
[GitHub](https://github.com/huggingface/diffusers), [Docs](https://huggingface.co/docs/diffusers/index)
In this organization, you can find some utilities and models we have made for you 🫶
## 🆕 SDXL Inpainting 🎨
We are training Inpainting specialist models for Stable Diffusion XL ✨. They are way better at inpainting and outpainting than the base-model, but are still experimental. Try it out and consider giving feedback! 🤗
| Inpanting model | Demo |
|-----------------------------------|---------------------|
| [`stable-diffusion-xl-1.0-inpainting-0.1`](https://huggingface.co/diffusers/stable-diffusion-xl-1.0-inpainting-0.1) | [Spaces demo 🕹️](https://huggingface.co/spaces/diffusers/stable-diffusion-xl-inpainting) |
## SDXL ControlNets
We are training ControlNets for Stable Diffusion XL ✨
### Small sized ControlNets 🤏
We are experimenting with training smaller ControlNets that can still retain their control capabilities! This is the [training script used](https://github.com/huggingface/diffusers/blob/7b93c2a882d8e12209fbaeffa51ee2b599ab5349/examples/research_projects/controlnet/train_controlnet_webdataset.py).
Please check the models released, and consider giving us feedback on our [Discord server](https://t.co/1n75wi976V?amp=1):
| ControlNet | Size in fp16 |
| ----------------------------------------------------------------------------------------------------- | ------------ |
| [`controlnet-canny-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small) | 320MB |
| [`controlnet-canny-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid) | 545MB |
| [`controlnet-depth-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small) | 320MB |
| [`controlnet-depth-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid) | 545MB |
### Full sized ControlNets 💪
The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a [ControlNet training script and guide here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md)
| ControlNet |
| ------------------------------------------------------------------------------------------------- |
| [`controlnet-canny-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0) |
| [`controlnet-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0) |
| [`controlnet-zoe-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-zoe-depth-sdxl-1.0) |
### Utilities 🔧
- [Convert Stable Diffusion XL weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sdxl-to-diffusers)
- [Convert Stable Diffusion weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sd-to-diffusers)
- [Convert diffusers models to `safetensors` format](https://huggingface.co/spaces/diffusers/convert)
More coming soon ✨
|