Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,44 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: flux-1-dev-non-commercial-license
|
4 |
+
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
library_name: diffusers
|
8 |
+
pipeline_tag: text-to-image
|
9 |
+
---
|
10 |
+
# FLUX.1 Merged Models - Several different Schnell:Dev ratios
|
11 |
+
|
12 |
+
This repository includes merged models for black-forest-labs/FLUX.1-dev and black-forest-labs/FLUX.1-schnell. The licenses of both models apply to these merged models.
|
13 |
+
|
14 |
+
Inspired by: https://huggingface.co/sayakpaul/FLUX.1-merged
|
15 |
+
|
16 |
+
## Motivation
|
17 |
+
|
18 |
+
The goal is to create modeld which balance generation speed - allowing near-Dev generations in more like 4-16 generations.
|
19 |
+
|
20 |
+
## Results
|
21 |
+
|
22 |
+
<img src="./images/astronaut_grid_688x512.png">
|
23 |
+
<img src="./images/hacker_grid_688x512.png">
|
24 |
+
<img src="./images/astronaut_grid_880x656.png">
|
25 |
+
<img src="./images/sign_grid_880x656.png">
|
26 |
+
<img src="./images/astronaut_grid_880x656_saved_models.png">
|
27 |
+
<img src="./images/sign_grid_880x656_saved_models.png">
|
28 |
+
|
29 |
+
Based on these results, I saved and uploaded models for the ratios 10:1, 4:1, and 2.5:1.
|
30 |
+
|
31 |
+
I recommend The following number of generation steps for these models:
|
32 |
+
| Model | Steps |
|
33 |
+
|-------|-------|
|
34 |
+
| 10:1 | 4-8 |
|
35 |
+
| 4:1 | 8-16 |
|
36 |
+
| 2.5:1 | 8-16+ |
|
37 |
+
|
38 |
+
## Procedure
|
39 |
+
|
40 |
+
I modified sayakpaul's merge code to do merges at various ratios (weights), rather than simply averaging the two 1:1, and generated a series of images with those models, and the originals. See [merge_compare.py](./merege_compare.py).
|
41 |
+
|
42 |
+
I first did a series of ratios ranging from mostly Schnell to mostly Dev. Based on those results, I did more tests with larger images in ratios favoring Schnell more.
|
43 |
+
|
44 |
+
From these tests, I saved and uploaded a few of my favorite ratios, namely 10:1, 4:1, and 2.5:1. Then I did some additional generations using those models, see [infer.py](./infer.py).
|