deadman44's picture
Update README.md
f870c35 verified
|
raw
history blame
21 kB
metadata
license: other
license_name: faipl-1.0-sd
license_link: https://freedevproject.org/faipl-1.0-sd/
language:
  - en
tags:
  - text-to-image
  - stable-diffusion
  - safetensors
  - stable-diffusion-xl

models


Zipanoob XL Vpred v1

-20000+ images Finetune trained

-Base model:NoobAI XL V-Pred 1.0
-dmd2_sdxl_4step_lora included
-ADetailer or HiresFix Recommendation.
-(forge)turn on Zero Terminal SNR
***Turn off when using flux or other epred models


Download: Zipanoob_XL_Vpred_v1.1.safetensors

- base model

-NoobAI XL V-Pred 1.0 -great XL model!

- trigger

japanese
european
3yo-30yo
myjd, myjk, myjc, myjsh, myjsm, myjsl, myjy (one of these)

- quality tags

masterpiece, best quality, realistic, photorealistic, mole, body freckles, 

- negative tags

low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits

- prompt

danbooru tag + natural english

- Sampling method

Euler a :6 steps

- Schedule type

SGM Uniform, KL Optimal, Normal, Simple

- cfg scale

1-1.5

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512

sample prompt

masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
19yo, myjd, japanese, 1girl, solo, black hair, long hair, brown eyes, makeup, lipstick, smile, closed mouth,
white dress, lace-trimmed dress, lace trim, laceshort sleeves, sleeveless,
looking at viewer, squatting, knees up,
depth of field, lens flare
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 429389538, Size: 896x1152, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.1, Hires Module 1: Use same choices, Hires CFG Scale: 1.3, Hires upscale: 2, Hires steps: 3, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae


masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
myjk, japanese, 2girls, multiple girls,
black hair, long hair, short hair, ponytail, bangs, brown eyes, school uniform, white shirt, short sleeves, bowtie,
smile, happy, looking at viewer, selfie, v, train interior, window
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 1091415239, Size: 1792x2304, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.1, Ultimate SD upscale upscaler: 4x-UltraSharp, Ultimate SD upscale tile_width: 896, Ultimate SD upscale tile_height: 1152, Ultimate SD upscale mask_blur: 8, Ultimate SD upscale padding: 32, Mask blur: 8, Inpaint area: Only masked, Masked area padding: 32, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae


masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
15yo, myjc, japanese, 1girl, solo,
very long hair, black hair, hair bow, black eyes,
blue dress, detached sleeves, wide sleeves, bare shoulders, blue skirt, fur-trimmed skirt, white over-kneehighs, white socks, boots,
grin, holding microphone, standing, looking at viewer, hand up, live stage, spot lighting, shadow, cowboy shot, winf
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 3192029900, Size: 896x1152, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.2, Hires Module 1: Use same choices, Hires CFG Scale: 1.3, Hires upscale: 2, Hires steps: 3, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae


Anime Characters (danbooru tag)

masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
10yo, myjsm, japanese, 1girl, solo, zundamon, white shirt, green overall, smile, looking at viewer, cowboy shot, outdoors, hands on own waist
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 3217608951, Size: 1792x2304, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.1, Ultimate SD upscale upscaler: 4x-UltraSharp, Ultimate SD upscale tile_width: 896, Ultimate SD upscale tile_height: 1152, Ultimate SD upscale mask_blur: 8, Ultimate SD upscale padding: 32, Mask blur: 8, Inpaint area: Only masked, Masked area padding: 32, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae


masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
myjc, european, frieren, fern \(sousou no frieren\), cosplay,
2girls, multiple girls, posing, at night, flash lighting, grin, looking at viewer, side-by-side
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 2061259503, Size: 1792x2304, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.1, Ultimate SD upscale upscaler: 4x-UltraSharp, Ultimate SD upscale tile_width: 896, Ultimate SD upscale tile_height: 1152, Ultimate SD upscale mask_blur: 8, Ultimate SD upscale padding: 32, Mask blur: 8, Inpaint area: Only masked, Masked area padding: 32, Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

masterpiece, best quality, realistic, photorealistic, mole, body freckles, body mole,
yoru \(spy x family\), anya \(spy x family\), 2girls, multiple girls, smile, sitting on chair, black uniform, natural lighting, looking at viewer, kitchen, side-by-side
Negative prompt: low quality, worst quality, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 1934868269, Size: 896x1152, Model hash: 2898567825, Model: Zipanoob_XL_Vpred_v1.1, Denoising strength: 0.1, Hires Module 1: Use same choices, Hires CFG Scale: 1.3, Hires upscale: 2, Hires steps: 3, Hires upscaler: R-ESRGAN 4x+, Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae



-Train Settings

base model: NoobAI-XL-Vpred-v0.75s.safetensors

caption: JoyCaption Alpha Two
tags: WD EVA02-Large Tagger v3

    --network_module "sdxl_train.py" ^
    --caption_dropout_rate="0" ^
    --vae_batch_size="1" ^
    --gradient_checkpointing ^
    --persistent_data_loader_workers ^
    --cache_latents ^
    --cache_latents_to_disk ^
    --max_data_loader_n_workers=2 ^
    --enable_bucket ^
    --bucket_no_upscale ^
    --save_model_as "safetensors" ^
    --mixed_precision "bf16" ^
    --learning_rate=5e-6 ^
    --train_text_encoder ^
    --learning_rate_te1=5e-7 ^
    --learning_rate_te2=5e-7 ^
    --resolution=1024,1024 ^
    --train_batch_size 2 ^
    --optimizer_type "adafactor" ^
    --optimizer_args "relative_step=False" "scale_parameter=False" "warmup_init=False"  ^
    --lr_scheduler "constant_with_warmup" ^
    --save_precision "bf16" ^
    --caption_extension ".txt" ^
    --no_half_vae ^
    --full_bf16 ^
    --max_grad_norm=0 ^
    --min_snr_gamma=5 ^
    --max_token_length=225 ^
    --fused_backward_pass ^
    --v_parameterization ^
    --zero_terminal_snr ^
    --save_state ^
    --xformers



Zipang XL test3.1

-4000+ twitter images trained & 10000+ images merged model

-Animagine XL 3.1 Base
-Good Lighting
-photoreal like tag: shadow, flash lighting, backlighting, silhouette, sunset, night, day, bokeh, etc.

Download:test3.1 (Recommended)
Download:test3.1b (Newer isn't always better)

These images are test3.1.

sample1
sample2
sample3
sample4
sample5
sample6
-refer to pnginfo

- base model

-Animagine XL 3.1 -great XL model!

- trigger

japanese
european
yo tag and myjs, myjc, myjk (e.g.:18yo, myjk)

- quality tags

masterpiece, best quality, very aesthetic, absurdres,

- negative tags

lowres, (bad), error, fewer, extra, missing, worst quality, low quality, extra digits

- sampler

DPM++ 2M SDE Heun Karras :24-28 steps
(Lightning)DPM++ 2M SGMUniform :8-14 steps
(Hyper-SD XL 8steps)DPM++ 2s a,DPM++ 2M SGM Uniform ;8-16 steps (Bad)

- cfg scale

3-5
(Lightning):1-3
(Hyper-SD XL):1

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512 (hires.fix required)

Sample prompt

-SDXL Lightning (too fast: recommended)

masterpiece, best quality, very aesthetic, absurdres,
16yo, japanese, myjk, 1girl, solo, backlighting, silhouette, horizon, sunset, wind, water, outdoors, wading, scenery, white dress, photo background, skirt hold, realistic, long hair, standing, barefoot, from behind, facing away, close-up
Negative prompt: lowres, (bad), error, fewer, extra, missing, worst quality, low quality, extra digits

Steps: 24, Sampler: DPM++ 2M SDE Heun Karras, CFG scale: 3, Seed: 2770074115, Size: 896x1152, Model hash: 90bbe169ac, Model: zipang_XL_test3.1.fp16, Denoising strength: 0.3, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Version: f0.0.17v1.8.0rc-latest-276-g29be1da7


-train
base1:trained 4000+images:manual tagging (Prodigy:70epoch)
model:trained 10000+images:wd14 tagger(swinv2 tagger v3) (base model:base1)(Nadam:lr:1e-04:27epoch)



Ponypang XL giveup

This is an incomplete model.

Mixed LoRA due to problems with training not being able to continue.
e621 tag might be better than danbooru tag.


-4000+ twitter images trained & 10000+ images merged model

-experimental
-Might look like Zipang.
-Hand is not good.
-ADetailer and HiresFix Recommendation.

Download: fix5
Download: fix4

These images are fix4.

sample1
sample2
sample3
sample4
sample5
sample6
-refer to pnginfo

- base model

-Pony Diffusion V6 XL -great XL model!
-ebara pony 2.1 -great XL model! too

- trigger

japanese
european
yo tag and myjs, myjc, myjk (e.g.:18yo, myjk)

- quality tags

score_9, score_8_up, score_7_up, masterpiece, best quality, realistic, photorealistic, 

- negative tags

worst quality, low quality, normal quality, messy drawing, amateur drawing, lowres, bad anatomy, bad hands, source furry, source pony, source cartoon, comic, source filmmaker, 3d, \(bad\), error, fewer, missing, extra digits



- sampler

DPM++ 2M SDE Heun Karras :24-28 steps
DPM++ SGM Uniform, DPM++ 2s a :8-16 steps (HyperSDXL)

Hyper-SDXL-8steps-lora

- cfg scale

3-7
1-1.5 (HyperSDXL)

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512 (hires.fix required)

sample prompt

score_9, score_8_up, score_7_up, masterpiece, best quality,
18yo, myjk, japanese, realistic, photorealistic,
1girl, solo, black hair, long hair, bangs, brown eyes, animal ears,school uniform,
stuffed toy, stuffed animal, teddy bear,
looking at viewer, grin, holding stuffed toy, upper body, sitting, hairband
Negative prompt: worst quality, low quality, normal quality, messy drawing, amateur drawing, lowres, bad anatomy, bad hands, source furry, source pony, source cartoon, comic, source filmmaker, 3d, \(bad\), error, fewer, missing, extra digits
Steps: 28, Sampler: DPM++ 2M SDE Heun Karras, CFG scale: 4, Seed: 2317472872, Size: 896x1152, Model hash: 58cd1b19e0, Model: ponypang_XL_giveup_fix4.fp16, Version: f0.0.17v1.8.0rc-latest-287-g77bdb9208

-merge & train

base1:ebara pony 2.1 base Trained.
base2:base1 x ebara base LoRA (1,1,1,1,0.3,0.3,0.3,0.3,0.5,0.75,0,0,0,0.75,1,0.9,0.5,0.3,0.3,0.3,1,1,0,0,0,0)
base3:Merge Zipang test3.1 (0,0,0,0,0,0,0,0,0,0.5,0,0.3,0,0.1,0,0,0,0,0,0)
base4:base3 x pony base LoRA (0,0,0,0,0,0.1,0.25,0,0,0.7,0,0,0,0.5,0.25,1,0,0.1,0.75,0.65,0,0,0,0,0,0)
fix: base4 base trained (Lion 1e-07)