pretzinger commited on
Commit
1d36fe1
·
verified ·
1 Parent(s): 9a87700

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +46 -0
  2. config.yaml +84 -0
  3. lora.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: flux-1-dev-non-commercial-license
4
+ license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
+ language:
6
+ - en
7
+ tags:
8
+ - flux
9
+ - diffusers
10
+ - lora
11
+ - replicate
12
+ base_model: "black-forest-labs/FLUX.1-dev"
13
+ pipeline_tag: text-to-image
14
+ # widget:
15
+ # - text: >-
16
+ # prompt
17
+ # output:
18
+ # url: https://...
19
+ instance_prompt: TOK
20
+ ---
21
+
22
+ # Getfluxxed
23
+
24
+ <Gallery />
25
+
26
+ Trained on Replicate using:
27
+
28
+ https://replicate.com/ostris/flux-dev-lora-trainer/train
29
+
30
+
31
+ ## Trigger words
32
+ You should use `TOK` to trigger the image generation.
33
+
34
+
35
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
36
+
37
+ ```py
38
+ from diffusers import AutoPipelineForText2Image
39
+ import torch
40
+
41
+ pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
42
+ pipeline.load_lora_weights('pretzinger/getfluxxed', weight_name='lora.safetensors')
43
+ image = pipeline('your prompt').images[0]
44
+ ```
45
+
46
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
config.yaml ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ job: custom_job
2
+ config:
3
+ name: flux_train_replicate
4
+ process:
5
+ - type: custom_sd_trainer
6
+ training_folder: output
7
+ device: cuda:0
8
+ trigger_word: TOK
9
+ network:
10
+ type: lora
11
+ linear: 16
12
+ linear_alpha: 16
13
+ network_kwargs:
14
+ only_if_contains:
15
+ - transformer.transformer_blocks.16.norm1.linear
16
+ - transformer.transformer_blocks.16.norm1_context.linear
17
+ - transformer.transformer_blocks.16.attn.to_q
18
+ - transformer.transformer_blocks.16.attn.to_k
19
+ - transformer.transformer_blocks.16.attn.to_v
20
+ - transformer.transformer_blocks.16.attn.add_k_proj
21
+ - transformer.transformer_blocks.16.attn.add_v_proj
22
+ - transformer.transformer_blocks.16.attn.add_q_proj
23
+ - transformer.transformer_blocks.16.attn.to_out.0
24
+ - transformer.transformer_blocks.16.attn.to_add_out
25
+ - transformer.transformer_blocks.16.ff.net.0.proj
26
+ - transformer.transformer_blocks.16.ff.net.2
27
+ - transformer.transformer_blocks.16.ff_context.net.0.proj
28
+ - transformer.transformer_blocks.16.ff_context.net.2
29
+ - transformer.single_transformer_blocks.16.norm.linear
30
+ - transformer.single_transformer_blocks.16.proj_mlp
31
+ - transformer.single_transformer_blocks.16.proj_out
32
+ - transformer.single_transformer_blocks.16.attn.to_q
33
+ - transformer.single_transformer_blocks.16.attn.to_k
34
+ - transformer.single_transformer_blocks.16.attn.to_v
35
+ save:
36
+ dtype: float16
37
+ save_every: 100
38
+ max_step_saves_to_keep: 1
39
+ datasets:
40
+ - folder_path: input_images
41
+ caption_ext: txt
42
+ caption_dropout_rate: 0.05
43
+ shuffle_tokens: false
44
+ cache_latents_to_disk: false
45
+ cache_latents: true
46
+ resolution:
47
+ - 512
48
+ - 768
49
+ - 1024
50
+ train:
51
+ batch_size: 1
52
+ steps: 1716
53
+ gradient_accumulation_steps: 1
54
+ train_unet: true
55
+ train_text_encoder: false
56
+ content_or_style: balanced
57
+ gradient_checkpointing: true
58
+ noise_scheduler: flowmatch
59
+ optimizer: adamw8bit
60
+ lr: 0.0004
61
+ ema_config:
62
+ use_ema: true
63
+ ema_decay: 0.99
64
+ dtype: bf16
65
+ model:
66
+ name_or_path: FLUX.1-dev
67
+ is_flux: true
68
+ quantize: true
69
+ sample:
70
+ sampler: flowmatch
71
+ sample_every: 100
72
+ width: 1024
73
+ height: 1024
74
+ prompts:
75
+ - create high quality appealing images representing the insurance dudes and
76
+ the telefunnel system, always corretcing any spelling prior to final generation
77
+ neg: ''
78
+ seed: 42
79
+ walk_seed: true
80
+ guidance_scale: 3.5
81
+ sample_steps: 28
82
+ meta:
83
+ name: flux_train_replicate
84
+ version: '1.0'
lora.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93ade001afa026eaf3dc0354d0882a53f8b580c0d29292a2333345db9e638a09
3
+ size 6985352