Nishitbaria commited on
Commit
ce2cbc8
1 Parent(s): 5d1552a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -60
README.md CHANGED
@@ -3,78 +3,44 @@ license: other
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
  language:
6
- - en
7
  tags:
8
- - flux
9
- - diffusers
10
- - lora
11
- - replicate
12
- - anime
13
- - text-to-image
14
- base_model: black-forest-labs/FLUX.1-dev
15
  pipeline_tag: text-to-image
 
 
 
 
 
16
  instance_prompt: animexl
17
- widget:
18
- - example_title: Futuristic Samurai
19
- inputs:
20
- prompt: animexl a cyberpunk samurai standing on a neon-lit rooftop, wearing black armor with glowing blue patterns, holding a katana with an electric blade, a bustling futuristic city in the background with flying cars and holographic billboards, cinematic lighting
21
- outputs:
22
- - image: https://example.com/samurai.png
23
- - example_title: Magical Forest Scene
24
- inputs:
25
- prompt: animexl an ethereal elf princess with glowing silver hair, wearing a flowing emerald gown adorned with golden patterns, sitting by a glowing blue lake in an enchanted forest, surrounded by bioluminescent flowers, glowing fireflies, and ancient stone ruins covered in moss
26
- outputs:
27
- - image: https://example.com/forest.png
28
  ---
29
 
30
- # AnimeXL - Fine-Tuned LoRA for Anime Image Generation
31
 
32
- AnimeXL is a LoRA fine-tuned using 200+ anime-style images over 2500 training steps. It specializes in creating vibrant, highly detailed anime-style visuals. The model leverages the **FLUX.1-dev** base model and is compatible with the 🧨 `diffusers` library for seamless integration.
33
 
34
- ---
35
-
36
- ## Features
37
- - **Trigger Word:** Use `animexl` in prompts to activate the model.
38
- - **High Compatibility:** Fully integrated with `diffusers` and works with FLUX.1-dev.
39
- - **Specialized Output:** Designed to generate anime-style artwork, perfect for creative projects.
40
 
41
- ## How to Use
42
 
43
- ### Using 🧨 Diffusers
44
- ```python
45
- from diffusers import AutoPipelineForText2Image
46
- import torch
47
 
48
- # Load the base pipeline
49
- pipeline = AutoPipelineForText2Image.from_pretrained(
50
- "black-forest-labs/FLUX.1-dev",
51
- torch_dtype=torch.float16
52
- ).to("cuda")
53
 
54
- # Load the LoRA weights
55
- pipeline.load_lora_weights("Nishit2411/AnimeXL", weight_name="lora.safetensors")
56
 
57
- # Generate an image
58
- prompt = "animexl a futuristic city with anime characters"
59
- image = pipeline(prompt).images[0]
60
 
61
- # Save or display the image
62
- image.save("output.png")
63
-
64
- Trigger Words
65
- Use animexl in prompts to achieve optimal results. Example prompts:
66
 
67
- animexl a magical girl in a serene forest
68
- animexl a samurai standing under a cherry blossom tree at sunset
69
- About Training
70
- AnimeXL was trained on Replicate's LoRA Trainer using the following configuration:
71
 
72
- Base Model: FLUX.1-dev
73
- Training Steps: 2500
74
- Images: 200+ anime-style images
75
- Resolution: 512x512, 768x768, and 1024x1024
76
- Batch Size: 1
77
- Optimizer: AdamW8bit with a learning rate of 0.0004
78
- Scheduler: Flowmatch
79
- Sampling: Flowmatch with 28 steps, guidance scale of 3.5
80
- For more details, refer to Replicate's LoRA Trainer Documentation.
 
3
  license_name: flux-1-dev-non-commercial-license
4
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
5
  language:
6
+ - en
7
  tags:
8
+ - flux
9
+ - diffusers
10
+ - lora
11
+ - replicate
12
+ base_model: "black-forest-labs/FLUX.1-dev"
 
 
13
  pipeline_tag: text-to-image
14
+ # widget:
15
+ # - text: >-
16
+ # prompt
17
+ # output:
18
+ # url: https://...
19
  instance_prompt: animexl
 
 
 
 
 
 
 
 
 
 
 
20
  ---
21
 
22
+ # Animexl
23
 
24
+ <Gallery />
25
 
26
+ Trained on Replicate using:
 
 
 
 
 
27
 
28
+ https://replicate.com/ostris/flux-dev-lora-trainer/train
29
 
 
 
 
 
30
 
31
+ ## Trigger words
32
+ You should use `animexl` to trigger the image generation.
 
 
 
33
 
 
 
34
 
35
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
 
 
36
 
37
+ ```py
38
+ from diffusers import AutoPipelineForText2Image
39
+ import torch
 
 
40
 
41
+ pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
42
+ pipeline.load_lora_weights('Nishit2411/AnimeXL', weight_name='lora.safetensors')
43
+ image = pipeline('your prompt').images[0]
44
+ ```
45
 
46
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)