RunDiffusion
commited on
Commit
•
64c1cad
1
Parent(s):
735a48a
fix
Browse files
README.md
CHANGED
@@ -133,7 +133,9 @@ We're not going to dive into the rank and learning rate and stuff because this r
|
|
133 |
- Default config with LR 4e-4 at Rank 16
|
134 |
- 2200 - 2600 steps saw good convergence. Even some checkpoints into the 4k step range turned out pretty good.
|
135 |
If targeting finer details, you may want to adjust the rank up to 32 and lower the learning rate. You will also need to run more steps if you do this.
|
|
|
136 |
**Training a style:** Using simple captions with clear examples to maintain a coherent style is crucial. Although caption-less LoRAs can sometimes work for styles, this was not within the scope of our goals, so we cannot provide specific insights.
|
|
|
137 |
**Training a concept:** You can choose either descriptive captions to avoid interfering with existing tokens or general captions that might interfere, depending on your intention. This choice should be intentional.
|
138 |
|
139 |
Captioning has never been more critical. Flux "gives you what you ask for" - and that's a good thing. You can train a LoRA on a single cartoon concept and still generate photo realistic people. You can even caption a cartoon in the foreground and a realistic scene in the background! This capability is BY DESIGN - so do not resist it - embrace it! (Spoiler alert next!)
|
|
|
133 |
- Default config with LR 4e-4 at Rank 16
|
134 |
- 2200 - 2600 steps saw good convergence. Even some checkpoints into the 4k step range turned out pretty good.
|
135 |
If targeting finer details, you may want to adjust the rank up to 32 and lower the learning rate. You will also need to run more steps if you do this.
|
136 |
+
|
137 |
**Training a style:** Using simple captions with clear examples to maintain a coherent style is crucial. Although caption-less LoRAs can sometimes work for styles, this was not within the scope of our goals, so we cannot provide specific insights.
|
138 |
+
|
139 |
**Training a concept:** You can choose either descriptive captions to avoid interfering with existing tokens or general captions that might interfere, depending on your intention. This choice should be intentional.
|
140 |
|
141 |
Captioning has never been more critical. Flux "gives you what you ask for" - and that's a good thing. You can train a LoRA on a single cartoon concept and still generate photo realistic people. You can even caption a cartoon in the foreground and a realistic scene in the background! This capability is BY DESIGN - so do not resist it - embrace it! (Spoiler alert next!)
|