controlnet-union-sdxl-1.0
#14
by
lia0
- opened
- README.md +0 -50
- config_promax.json +0 -57
- diffusion_pytorch_model_promax.safetensors +0 -3
- images/100000_tile_blur_concat.webp +0 -0
- images/100001_tile_blur_concat.webp +0 -0
- images/100002_tile_blur_concat.webp +0 -0
- images/100003_tile_blur_concat.webp +0 -0
- images/100004_tile_blur_concat.webp +0 -0
- images/100005_tile_blur_concat.webp +0 -0
- images/100006_tile_var_concat.webp +0 -0
- images/100007_tile_var_concat.webp +0 -0
- images/100008_tile_var_concat.webp +0 -0
- images/100009_tile_var_concat.webp +0 -0
- images/100010_tile_var_concat.webp +0 -0
- images/100011_tile_var_concat.webp +0 -0
- images/100012_outpainting_concat.webp +0 -0
- images/100013_outpainting_concat.webp +0 -0
- images/100014_outpainting_concat.webp +0 -0
- images/100015_outpainting_concat.webp +0 -0
- images/100016_outpainting_concat.webp +0 -0
- images/100017_outpainting_concat.webp +0 -0
- images/100018_inpainting_concat.webp +0 -0
- images/100019_inpainting_concat.webp +0 -0
- images/100020_inpainting_concat.webp +0 -0
- images/100021_inpainting_concat.webp +0 -0
- images/100022_inpainting_concat.webp +0 -0
- images/100023_inpainting_concat.webp +0 -0
- images/tile_super1.webp +0 -0
- images/tile_super1_9upscale.webp +0 -0
- images/tile_super2.webp +0 -0
- images/tile_super2_9upscale.webp +0 -0
README.md
CHANGED
@@ -9,7 +9,6 @@ pipeline_tag: text-to-image
|
|
9 |
---
|
10 |
|
11 |
# **ControlNet++: All-in-one ControlNet for image generations and editing!**
|
12 |
-
## **ProMax Model has released!! 12 control + 5 advanced editing, just try it!!!**
|
13 |
![images_display](./images/masonry.webp)
|
14 |
|
15 |
## Network Arichitecture
|
@@ -37,55 +36,6 @@ Inference scripts and more details can found: https://github.com/xinsir6/Control
|
|
37 |
|
38 |
**If you find it useful, please give me a star, thank you very much**
|
39 |
|
40 |
-
**SDXL ProMax version has been released!!!,Enjoy it!!!**
|
41 |
-
|
42 |
-
**I am sorry that because of the project's revenue and expenditure are difficult to balance, the GPU resources are assigned to other projects that are more likely to be profitable, the SD3 trainging is stopped until I find enough GPU supprt, I will try my best to find GPUs to continue training. If this brings you inconvenience, I sincerely apologize for that. I want to thank everyone who likes this project, your support is what keeps me going**
|
43 |
-
|
44 |
-
Note: we put the promax model with a promax suffix in the same [huggingface model repo](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0), detailed instructions will be added later.
|
45 |
-
## Advanced editing features in Promax Model
|
46 |
-
### Tile Deblur
|
47 |
-
![blur0](./images/100000_tile_blur_concat.webp)
|
48 |
-
![blur1](./images/100001_tile_blur_concat.webp)
|
49 |
-
![blur2](./images/100002_tile_blur_concat.webp)
|
50 |
-
![blur3](./images/100003_tile_blur_concat.webp)
|
51 |
-
![blur4](./images/100004_tile_blur_concat.webp)
|
52 |
-
![blur5](./images/100005_tile_blur_concat.webp)
|
53 |
-
### Tile variation
|
54 |
-
![var0](./images/100006_tile_var_concat.webp)
|
55 |
-
![var1](./images/100007_tile_var_concat.webp)
|
56 |
-
![var2](./images/100008_tile_var_concat.webp)
|
57 |
-
![var3](./images/100009_tile_var_concat.webp)
|
58 |
-
![var4](./images/100010_tile_var_concat.webp)
|
59 |
-
![var5](./images/100011_tile_var_concat.webp)
|
60 |
-
|
61 |
-
### Tile Super Resolution
|
62 |
-
Following example show from 1M resolution --> 9M resolution
|
63 |
-
<div style="display: flex; justify-content: space-between;">
|
64 |
-
<img src="./images/tile_super1.webp" alt="Image 1" style="width: 49%; margin: 1%;">
|
65 |
-
<img src="./images/tile_super1_9upscale.webp" alt="Image 2" style="width: 49%; margin: 1%;">
|
66 |
-
</div>
|
67 |
-
|
68 |
-
<div style="display: flex; justify-content: space-between;">
|
69 |
-
<img src="./images/tile_super2.webp" alt="Image 1" style="width: 49%; margin: 1%;">
|
70 |
-
<img src="./images/tile_super2_9upscale.webp" alt="Image 2" style="width: 49%; margin: 1%;">
|
71 |
-
</div>
|
72 |
-
|
73 |
-
### Image Inpainting
|
74 |
-
![inp0](./images/100018_inpainting_concat.webp)
|
75 |
-
![inp1](./images/100019_inpainting_concat.webp)
|
76 |
-
![inp2](./images/100020_inpainting_concat.webp)
|
77 |
-
![inp3](./images/100021_inpainting_concat.webp)
|
78 |
-
![inp4](./images/100022_inpainting_concat.webp)
|
79 |
-
![inp5](./images/100023_inpainting_concat.webp)
|
80 |
-
|
81 |
-
### Image Outpainting
|
82 |
-
![oup0](./images/100012_outpainting_concat.webp)
|
83 |
-
![oup1](./images/100013_outpainting_concat.webp)
|
84 |
-
![oup2](./images/100014_outpainting_concat.webp)
|
85 |
-
![oup3](./images/100015_outpainting_concat.webp)
|
86 |
-
![oup4](./images/100016_outpainting_concat.webp)
|
87 |
-
![oup5](./images/100017_outpainting_concat.webp)
|
88 |
-
|
89 |
|
90 |
## Visual Examples
|
91 |
### Openpose
|
|
|
9 |
---
|
10 |
|
11 |
# **ControlNet++: All-in-one ControlNet for image generations and editing!**
|
|
|
12 |
![images_display](./images/masonry.webp)
|
13 |
|
14 |
## Network Arichitecture
|
|
|
36 |
|
37 |
**If you find it useful, please give me a star, thank you very much**
|
38 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
39 |
|
40 |
## Visual Examples
|
41 |
### Openpose
|
config_promax.json
DELETED
@@ -1,57 +0,0 @@
|
|
1 |
-
{
|
2 |
-
"_class_name": "ControlNetModel",
|
3 |
-
"_diffusers_version": "0.20.0.dev0",
|
4 |
-
"act_fn": "silu",
|
5 |
-
"addition_embed_type": "text_time",
|
6 |
-
"addition_embed_type_num_heads": 64,
|
7 |
-
"addition_time_embed_dim": 256,
|
8 |
-
"attention_head_dim": [
|
9 |
-
5,
|
10 |
-
10,
|
11 |
-
20
|
12 |
-
],
|
13 |
-
"block_out_channels": [
|
14 |
-
320,
|
15 |
-
640,
|
16 |
-
1280
|
17 |
-
],
|
18 |
-
"class_embed_type": null,
|
19 |
-
"conditioning_channels": 3,
|
20 |
-
"conditioning_embedding_out_channels": [
|
21 |
-
16,
|
22 |
-
32,
|
23 |
-
96,
|
24 |
-
256
|
25 |
-
],
|
26 |
-
"controlnet_conditioning_channel_order": "rgb",
|
27 |
-
"cross_attention_dim": 2048,
|
28 |
-
"down_block_types": [
|
29 |
-
"DownBlock2D",
|
30 |
-
"CrossAttnDownBlock2D",
|
31 |
-
"CrossAttnDownBlock2D"
|
32 |
-
],
|
33 |
-
"downsample_padding": 1,
|
34 |
-
"encoder_hid_dim": null,
|
35 |
-
"encoder_hid_dim_type": null,
|
36 |
-
"flip_sin_to_cos": true,
|
37 |
-
"freq_shift": 0,
|
38 |
-
"global_pool_conditions": false,
|
39 |
-
"in_channels": 4,
|
40 |
-
"layers_per_block": 2,
|
41 |
-
"mid_block_scale_factor": 1,
|
42 |
-
"norm_eps": 1e-05,
|
43 |
-
"norm_num_groups": 32,
|
44 |
-
"num_attention_heads": null,
|
45 |
-
"num_class_embeds": null,
|
46 |
-
"only_cross_attention": false,
|
47 |
-
"projection_class_embeddings_input_dim": 2816,
|
48 |
-
"resnet_time_scale_shift": "default",
|
49 |
-
"transformer_layers_per_block": [
|
50 |
-
1,
|
51 |
-
2,
|
52 |
-
10
|
53 |
-
],
|
54 |
-
"upcast_attention": null,
|
55 |
-
"use_linear_projection": true,
|
56 |
-
"num_control_type": 8
|
57 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
diffusion_pytorch_model_promax.safetensors
DELETED
@@ -1,3 +0,0 @@
|
|
1 |
-
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:9fae2e50cb431bfcbe05822b59ec2228df545ef27f711dea8949e9f4ed9f7cdc
|
3 |
-
size 2513342408
|
|
|
|
|
|
|
|
images/100000_tile_blur_concat.webp
DELETED
Binary file (297 kB)
|
|
images/100001_tile_blur_concat.webp
DELETED
Binary file (396 kB)
|
|
images/100002_tile_blur_concat.webp
DELETED
Binary file (312 kB)
|
|
images/100003_tile_blur_concat.webp
DELETED
Binary file (524 kB)
|
|
images/100004_tile_blur_concat.webp
DELETED
Binary file (179 kB)
|
|
images/100005_tile_blur_concat.webp
DELETED
Binary file (469 kB)
|
|
images/100006_tile_var_concat.webp
DELETED
Binary file (234 kB)
|
|
images/100007_tile_var_concat.webp
DELETED
Binary file (315 kB)
|
|
images/100008_tile_var_concat.webp
DELETED
Binary file (601 kB)
|
|
images/100009_tile_var_concat.webp
DELETED
Binary file (486 kB)
|
|
images/100010_tile_var_concat.webp
DELETED
Binary file (932 kB)
|
|
images/100011_tile_var_concat.webp
DELETED
Binary file (204 kB)
|
|
images/100012_outpainting_concat.webp
DELETED
Binary file (629 kB)
|
|
images/100013_outpainting_concat.webp
DELETED
Binary file (230 kB)
|
|
images/100014_outpainting_concat.webp
DELETED
Binary file (276 kB)
|
|
images/100015_outpainting_concat.webp
DELETED
Binary file (461 kB)
|
|
images/100016_outpainting_concat.webp
DELETED
Binary file (201 kB)
|
|
images/100017_outpainting_concat.webp
DELETED
Binary file (136 kB)
|
|
images/100018_inpainting_concat.webp
DELETED
Binary file (120 kB)
|
|
images/100019_inpainting_concat.webp
DELETED
Binary file (231 kB)
|
|
images/100020_inpainting_concat.webp
DELETED
Binary file (520 kB)
|
|
images/100021_inpainting_concat.webp
DELETED
Binary file (187 kB)
|
|
images/100022_inpainting_concat.webp
DELETED
Binary file (138 kB)
|
|
images/100023_inpainting_concat.webp
DELETED
Binary file (305 kB)
|
|
images/tile_super1.webp
DELETED
Binary file (115 kB)
|
|
images/tile_super1_9upscale.webp
DELETED
Binary file (898 kB)
|
|
images/tile_super2.webp
DELETED
Binary file (47.8 kB)
|
|
images/tile_super2_9upscale.webp
DELETED
Binary file (368 kB)
|
|