Duplicate from Laxhar/noob_sdxl_v_pred
Browse filesCo-authored-by: Euge <[email protected]>
- .gitattributes +35 -0
- LICENSE +0 -0
- README.md +70 -0
- noob-xl-v-pred-test-v1.safetensors +3 -0
- noob-xl-v-pred-test-v2.safetensors +3 -0
- vpred-model/Vpred-checkpoint-e0_s4000.safetensors +3 -0
- vpred-model/Vpred-checkpoint-e0_s5000.safetensors +3 -0
.gitattributes
ADDED
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
File without changes
|
README.md
ADDED
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- Laxhar/sdxl_noob
|
7 |
+
pipeline_tag: text-to-image
|
8 |
+
library_name: diffusers
|
9 |
+
---
|
10 |
+
|
11 |
+
<h1 align="center"><strong style="font-size: 48px;">NoobAI XL (V预测分支)</strong></h1>
|
12 |
+
|
13 |
+
该模型页面为 NoobAI XL 的 V 预测分支,无法在 AUTOMATIC1111 WebUI 中使用。
|
14 |
+
请通过 diffusers, ComfyUI[https://github.com/comfyanonymous/ComfyUI] 或 [reForge
|
15 |
+
](https://github.com/Panchovix/stable-diffusion-webui-reForge/) 使用。
|
16 |
+
|
17 |
+
# 基本信息
|
18 |
+
|
19 |
+
模型使用约 300k 图像,在 [该检查点](https://huggingface.co/Laxhar/noob_sdxl_beta/blob/main/app/noob_hercules/fp16/checkpoint-e0_s35000.safetensors/checkpoint-e0_s35000.safetensors) 训练而成。
|
20 |
+
|
21 |
+
训练的第一阶段,仅训练 UNet 的 OUT 层,以较低的学习率(3e-6)微调,直到 V 预测基本能够正常工作。
|
22 |
+
训练的第二阶段,恢复所有其它参数,训练一个完整的 epoch。
|
23 |
+
|
24 |
+
# 如何使用?
|
25 |
+
|
26 |
+
## 用法:reForge
|
27 |
+
|
28 |
+
1. 安装 reForge;
|
29 |
+
2. 切换为 dev_upstream_experimental 分支,即运行 `git checkout dev_upstream_experimental`;
|
30 |
+
3. 启动 reForge WebUI;
|
31 |
+
4. 在页面下方找到 “Advanced Model Sampling for Forge”;
|
32 |
+
5. 启用 “Enable Advanced Model Sampling”;
|
33 |
+
6. 在 “Discrete Sampling Type” 中选择 “v_prediction”。
|
34 |
+
|
35 |
+
## 用法:Diffusers
|
36 |
+
|
37 |
+
```python
|
38 |
+
import torch
|
39 |
+
from diffusers import StableDiffusionXLPipeline, EulerAncestralDiscreteScheduler
|
40 |
+
|
41 |
+
ckpt_path = "/path/to/model.safetensors"
|
42 |
+
pipe = StableDiffusionXLPipeline.from_single_file(
|
43 |
+
ckpt_path,
|
44 |
+
use_safetensors=True,
|
45 |
+
torch_dtype=torch.float16,
|
46 |
+
)
|
47 |
+
pipe.scheduler = EulerAncestralDiscreteScheduler.from_config(pipe.scheduler.config)
|
48 |
+
pipe.scheduler.register_to_config(
|
49 |
+
prediction_type="v_prediction",
|
50 |
+
rescale_betas_zero_snr=True,
|
51 |
+
)
|
52 |
+
pipe.enable_xformers_memory_efficient_attention()
|
53 |
+
pipe = pipe.to("cuda")
|
54 |
+
|
55 |
+
prompt = "best quality, 1boy, solo"
|
56 |
+
negative_prompt = "bad hands, worst quality, low quality, bad quality, multiple views, 4koma, comic, jpeg artifacts, monochrome, sepia, greyscale, flat color, pale color, muted color, low contrast, bad anatomy, picture frame, english text, signature, watermark, logo, patreon username, web address, artist name"
|
57 |
+
|
58 |
+
image = pipe(
|
59 |
+
prompt=prompt,
|
60 |
+
negative_prompt=negative_prompt,
|
61 |
+
width=832,
|
62 |
+
height=1216,
|
63 |
+
num_inference_steps=28,
|
64 |
+
guidance_scale=7.0,
|
65 |
+
generator=torch.Generator().manual_seed(42),
|
66 |
+
|
67 |
+
).images[0]
|
68 |
+
|
69 |
+
image.save('image.png')
|
70 |
+
```
|
noob-xl-v-pred-test-v1.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:85e6db6c8ed207c78ee4bea07ba9fa23573784bbcaf45399c88e88c914ad4fc4
|
3 |
+
size 6938040400
|
noob-xl-v-pred-test-v2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d4e7a4249ca3f7a38c32ad1a9551ae6597e0fe0f87f41d204f9690da3addacab
|
3 |
+
size 6938040400
|
vpred-model/Vpred-checkpoint-e0_s4000.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:30c940b56bf1bf5e33cc7fa8d5f1d8570a9666c2402eac7fcf33ab91a1fb1e07
|
3 |
+
size 7105349958
|
vpred-model/Vpred-checkpoint-e0_s5000.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cd5b27226d1333e0b1cf4d9197c0bfbc546028786342bebfc1444a9abca3e569
|
3 |
+
size 7105349958
|