File size: 2,824 Bytes
5439a82 da1b6ee dc6b7f7 da1b6ee dc6b7f7 fa8fb67 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 |
---
license: other
license_name: fair-ai-public-license-1.0-sd
license_link: https://freedevproject.org/faipl-1.0-sd/
language:
- en
base_model: OnomaAIResearch/Illustrious-xl-early-release-v0
datasets:
- pls2000/aiart_channel_nai3_geachu
pipeline_tag: text-to-image
---
## Training (`arcaillous-xl.safetensors`)
Configuration refered from KBlueLeaf/Kohaku-XL-Zeta, using 2x3090 and sd-scripts.
### Command args
```
NCCL_P2P_DISABLE=1 NCCL_IB_DISABLE=1 accelerate launch --num_cpu_threads_per_process 4 sdxl_train.py \
--pretrained_model_name_or_path="/ai/data/sd/models/Stable-diffusion/Illustrious-XL-v0.1.safetensors" \
--dataset_config="arcaillous-xl.toml" \
--output_dir="results/ckpt" --output_name="arcaillous-xl" \
--save_model_as="safetensors" \
--gradient_accumulation_steps 64 \
--learning_rate=1e-5 --optimizer_type="Lion8bit" \
--lr_scheduler="constant_with_warmup" --lr_warmup_steps 100 --optimizer_args "weight_decay=0.01" "betas=0.9,0.95" --min_snr_gamma 5 \
--sdpa \
--no_half_vae \
--cache_latents --cache_latents_to_disk \
--gradient_checkpointing \
--full_bf16 --mixed_precision="bf16" --save_precision="bf16" \
--ddp_timeout=10000000 \
--max_train_epochs 4 --save_every_n_epochs 1 --save_every_n_steps 50 \
```
## Lora Training (`lora_arcain.safetensors`)
Results are simillar with arcaillous-xl with Illustrious-xl, but this lora can applied with other ILXL-based models such as NoobAI-XL.
Configuration is simillar to `arcaillous-xl`.
```
NCCL_P2P_DISABLE=1 NCCL_IB_DISABLE=1 accelerate launch --num_cpu_threads_per_process 4 sdxl_train_network.py \
--network_train_unet_only \
--network_module="networks.lora" --network_dim 256 --network_alpha 128 \
--pretrained_model_name_or_path="/ai/data/sd/models/Stable-diffusion/Illustrious-XL-v0.1.safetensors" \
--dataset_config="arcain.lora.toml" \
--output_dir="results/lora" --output_name="lora_arcain" \
--save_model_as="safetensors" \
--gradient_accumulation_steps 32 \
--learning_rate=1e-5 --optimizer_type="Lion8bit" \
--lr_scheduler="constant_with_warmup" --lr_warmup_steps 100 --optimizer_args "weight_decay=0.01" "betas=0.9,0.95" --min_snr_gamma 5 \
--sdpa \
--no_half_vae \
--cache_latents --cache_latents_to_disk \
--gradient_checkpointing \
--full_bf16 --mixed_precision="bf16" --save_precision="bf16" \
--ddp_timeout=10000000 \
--max_train_epochs 4 --save_every_n_epochs 1 --save_every_n_steps 50 \
```
## Merged model (`arcaillous-nbxl-v05.safetensors`)
Merging NoobAI-XL eps v0.5 and `lora_arcain`, merged on ComfyUI.
For more information, check the `Merge-arcain-nbxl.json` workflow file. |