Hugging Face's logo

DiffusionLight
/
TurboLoRA

Image-to-Image
Diffusers
StableDiffusionXLControlNetInpaintPipeline
stable-diffusion-xl
lora
template:sd-lora
inpainting
light-estimation
relighting
Model card Files Community
1
pureexe commited on
Commit
124539c
·
verified ·
1 Parent(s): f41fd94

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +114 -2
README.md CHANGED
@@ -2,10 +2,122 @@
2
  license: mit
3
  base_model:
4
  - stabilityai/stable-diffusion-xl-base-1.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # DiffusionLight's TurboLoRA
 
8
 
9
- Let's speed up DiffusionLight, this is for host and test temporary code, we will update full detail of this project later!
10
 
11
- Note that the Weight is the same as 'DiffusionLight/Flicker2k', but due to diffusers 0.33.0 breaking the compatibility, again we store it in a separate model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: mit
3
  base_model:
4
  - stabilityai/stable-diffusion-xl-base-1.0
5
+ pipeline_tag: image-to-image
6
+ tags:
7
+ - image-to-image
8
+ - StableDiffusionXLControlNetInpaintPipeline
9
+ - stable-diffusion-xl
10
+ - lora
11
+ - diffusers
12
+ - template:sd-lora
13
+ - inpainting
14
+ - light-estimation
15
+ - relighting
16
+ instance_prompt: >-
17
+ a perfect mirrored reflective chrome ball sphere, a perfect black dark
18
+ mirrored reflective chrome ball sphere
19
+ inference: false
20
  ---
21
 
22
  # DiffusionLight's TurboLoRA
23
+ [Project Page](https://diffusionlight.github.io/turbo) | [Code](https://github.com/DiffusionLight/DiffusionLight-Turbo-diffusers)
24
 
25
+ [![Open DiffusionLight in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/15pC4qb9mEtRYsW3utXkk-jnaeVxUy-0S?usp=sharing&sandboxMode=true)
26
 
27
+ <table>
28
+ <thead>
29
+ <tr>
30
+ <th colspan="3">
31
+ <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/backpacker_seed400.jpg" />
32
+ </th>
33
+ <th colspan="3">
34
+ <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/brick_apartment_seed400.jpg" />
35
+ </th>
36
+ <th colspan="3">
37
+ <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/yuurakuchou_seed600.jpg" />
38
+ </th>
39
+ <th colspan="3">
40
+ <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/hill_seed800.jpg" />
41
+ </th>
42
+ </tr>
43
+ </thead>
44
+ <tbody>
45
+ <tr>
46
+ <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td>
47
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_backpacker_seed400.png" /></td>
48
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_backpacker_seed400.png" /></td>
49
+ <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td>
50
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_brick_apartment_seed400.png" /></td>
51
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_brick_apartment_seed400.png" /></td>
52
+ <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td>
53
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_yuurakuchou_seed600.png" /></td>
54
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_yuurakuchou_seed600.png" /></td>
55
+ <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td>
56
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_hill_seed800.png" /></td>
57
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_hill_seed800.png" /></td>
58
+ </tr>
59
+ <tr>
60
+ <td><p align="center">DiffusionLight <br> 30 Minutes</p></td>
61
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_backpacker_seed400.png" /></td>
62
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_backpacker_seed400.png" /></td>
63
+ <td><p align="center">DiffusionLight <br> 30 Minutes</p></td>
64
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_brick_apartment_seed400.png" /></td>
65
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_brick_apartment_seed400.png" /></td>
66
+ <td><p align="center">DiffusionLight <br> 30 Minutes</p></td>
67
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_yuurakuchou_seed600.png" /></td>
68
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_yuurakuchou_seed600.png" /></td>
69
+ <td><p align="center">DiffusionLight <br> 30 Minutes</p></td>
70
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_hill_seed800.png" /></td>
71
+ <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_hill_seed800.png" /></td>
72
+ </tr>
73
+ <tr>
74
+ <td></td>
75
+ <td><p align="center">Normally exposed</p></td>
76
+ <td><p align="center">Under​exposed</p></td>
77
+ <td></td>
78
+ <td><p align="center">Normally exposed</p></td>
79
+ <td><p align="center">Under​exposed</p></td>
80
+ <td></td>
81
+ <td><p align="center">Normally exposed</p></td>
82
+ <td><p align="center">Under​exposed</p></td>
83
+ <td></td>
84
+ <td><p align="center">Normally exposed</p></td>
85
+ <td><p align="center">Under​exposed</p></td>
86
+ </tr>
87
+ </tbody>
88
+ </table>
89
+
90
+ ## Usage
91
+
92
+ This repository is the weight for an example code that shows how to implement DiffusionLight-Turbo `inpaint.py` in Diffusers `0.33.0`
93
+
94
+ We recommend checking out Github Repository: [Github](https://github.com/DiffusionLight/DiffusionLight-Turbo-diffusers)
95
+
96
+ Note that the Weight is the same as 'DiffusionLight/Flicker2k', but due to diffusers 0.33.0 breaking the compatibility, we have to store it in a separate model.
97
+
98
+ ## Download model
99
+
100
+ Weights for this model are available in Safetensors format.
101
+
102
+ [Download](/DiffusionLight/TurboLoRA/tree/main) them in the Files & versions tab.
103
+
104
+ ## Trigger words
105
+
106
+ | Chromeball | Prompt |
107
+ | ----------- | ----------- |
108
+ | Normally exposed | a perfect mirrored reflective chrome ball sphere |
109
+ | Underexposed | a perfect **black dark** mirrored reflective chrome ball sphere |
110
+
111
+ ## Citation
112
+
113
+ ```
114
+ @inproceedings{Chinchuthakun2025DiffusionLightTurbo,
115
+ author = {Chinchuthakun, Worameth and Phongthawee, Pakkapon and Raj, Amit and Jampani, Varun and Khungurn, Pramook and Suwajanakorn, Supasorn},
116
+ title = {DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting},
117
+ booktitle = {ArXiv},
118
+ year = {2025},
119
+ }
120
+ ```
121
+
122
+ ## Visit us 🦉
123
+ [![Vision & Learning Laboratory](https://i.imgur.com/hQhkKhG.png)](https://vistec.ist/vision) [![VISTEC - Vidyasirimedhi Institute of Science and Technology](https://i.imgur.com/4wh8HQd.png)](https://vistec.ist/)