Spaces:
Running
Running
File size: 3,391 Bytes
5d114a6 d63dc1f 915a562 0bae41a 915a562 d7a8807 d63dc1f 094a519 d7a8807 d4ade35 d7a8807 eb1e6c1 d7a8807 eb1e6c1 4c99e2d d7a8807 d63dc1f d7a8807 eb1e6c1 d7a8807 d63dc1f 0f87770 d7a8807 eb1e6c1 d63dc1f d7a8807 d63dc1f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 |
---
title: README
emoji: 📉
colorFrom: green
colorTo: purple
sdk: static
pinned: false
---
# Welcome to the 🧨 `diffusers` organization!
`diffusers` is the go-to library for state-of-the-art pretrained diffusion models for multi-modal generative AI.
[GitHub](https://github.com/huggingface/diffusers), [Docs](https://huggingface.co/docs/diffusers/index)
In this organization, you can find some utilities and models we have made for you 🫶
## 🆕 SDXL Inpainting 🎨
We are training Inpainting specialist models for Stable Diffusion XL ✨. They are way better at inpainting and outpainting than the base-model, but are still experimental. Try it out and consider giving feedback! 🤗
| Inpanting model | Demo |
|-----------------------------------|---------------------|
| [`inpainting-sdxl-0.1`](https://huggingface.co/diffusers/inpainting-sdxl-0.1) | [Spaces demo 🕹️](https://huggingface.co/spaces/diffusers/stable-diffusion-xl-inpainting) |
## SDXL ControlNets
We are training ControlNets for Stable Diffusion XL ✨
### Small sized ControlNets 🤏
We are experimenting with training smaller ControlNets that can still retain their control capabilities! This is the [training script used](https://github.com/huggingface/diffusers/blob/7b93c2a882d8e12209fbaeffa51ee2b599ab5349/examples/research_projects/controlnet/train_controlnet_webdataset.py).
Please check the models released, and consider giving us feedback on our [Discord server](https://t.co/1n75wi976V?amp=1):
| ControlNet | Size in fp16 |
| ----------------------------------------------------------------------------------------------------- | ------------ |
| [`controlnet-canny-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-small) | 320MB |
| [`controlnet-canny-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0-mid) | 545MB |
| [`controlnet-depth-sdxl-1.0-small`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-small) | 320MB |
| [`controlnet-depth-sdxl-1.0-mid`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0-mid) | 545MB |
### Full sized ControlNets 💪
The team has also trained full sized ControlNets - as big as the SDXL model (5GB in fp32). We have provided a [ControlNet training script and guide here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md)
| ControlNet |
| ------------------------------------------------------------------------------------------------- |
| [`controlnet-canny-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0) |
| [`controlnet-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0) |
| [`controlnet-zoe-depth-sdxl-1.0`](https://huggingface.co/diffusers/controlnet-zoe-depth-sdxl-1.0) |
### Utilities 🔧
- [Convert Stable Diffusion XL weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sdxl-to-diffusers)
- [Convert Stable Diffusion weights to `diffusers` format](https://huggingface.co/spaces/diffusers/sd-to-diffusers)
- [Convert diffusers models to `safetensors` format](https://huggingface.co/spaces/diffusers/convert)
More coming soon ✨
|