File size: 1,122 Bytes
8be6d81 a3fa2e1 8be6d81 c48b54f 8be6d81 c881b06 c48b54f 2f5e5d4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
pipeline_tag: text-to-image
library_name: diffusers
tags:
- pixart-alpha
- pixart-alpha-diffusers
- text-to-image
- diffusers
- controlnet
---
These are the weights for the Pixart HED Controlnet, converted to be used with the pixart alpha controlnet pipeline.
To use:
```bash
git clone https://github.com/raulc0399/PixArt-alpha.git .
git checkout master_train_controlnet_diffusers
pip install -r requirements.txt
python controlnet/pipeline/run_controlnet_pipeline.py
```
(make sure to change the input_image_path and prompt)
the weights were created using the controlnet/convert_pixart_alpha_controlnet_to_diffusers.py from the github repo
```bash
python controlnet/convert_pixart_alpha_controlnet_to_diffusers.py --orig_ckpt_path=<full path to>/PixArt-XL-2-1024-ControlNet.pth --dump_path=./<output folder>/hed-controlnet
```
the training script has been implemented in controlnet/train_pixart_controlnet_hf.py
to start it with the toy-dataset "fusing/fill50k" run the file ./train_controlnet_hf_diffusers.sh
more info can be found in this PR
https://github.com/PixArt-alpha/PixArt-alpha/pull/164 |