MidnightRunner commited on
Commit
f10b255
·
verified ·
1 Parent(s): b7b1646

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +173 -3
README.md CHANGED
@@ -1,3 +1,173 @@
1
- ---
2
- license: creativeml-openrail-m
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: creativeml-openrail-m
3
+ language:
4
+ - en
5
+ base_model: MidnightRunner/MIDNIGHT_NAI-XL_vPredV1
6
+ tags:
7
+ - SDXL
8
+ - noobai-XL
9
+ - Vpred-2.0
10
+ - text-to-image
11
+ - ComfyUI
12
+ - Automatic1111
13
+ - Diffuser
14
+ pipeline_tag: text-to-image
15
+ library_name: diffusers
16
+ datasets:
17
+ - LaxharLab/NoobAI-XL-dataset
18
+ metrics:
19
+ - FID
20
+ - IS
21
+ widget:
22
+ - text: >-
23
+ (high quality), (masterpiece), (detailed), photorealistic, cinematic, film grain, very awa, (beksinski:1.3)1girl, solo, voluminous, long hair, looking at viewer, semi-realistic, newest (2023), seductive expression, piercing gaze, open mouth, sitting, blurry background, pale skin, platinum white hair, busy background, dress, bow, ribbon, jewelry, bare shoulders, upper body, sleeveless, pointy ears, hand up, white dress, bracelet, medium breasts, sleeveless dress, skindentation, see-through clothes, silt eyes, black sclera, fangs, red bow, armlet, gold, red ribbon, vampire, dress bow, oshino shinobu, black choker, lips, looking at viewer, open mouth, ring, smile, smilingwide, teeth, prehensile tail, holding with tail, tail gripping whiskey jug, whiskey text label "jack daniels", jack daniels logo, tail gripping, sharp teeth
24
+ parameters:
25
+ negative_prompt: >-
26
+ lowres, worst quality, low quality, bad anatomy, bad hands, 4koma, comic, greyscale, censored, jpeg artifacts, overly saturated, overly vivid, (multiple views:1.1), (bad:1.05), fewer, extra, missing, worst quality, jpeg artifacts, bad quality, watermark, unfinished, displeasing, sepia, sketch, flat color, signature, artistic error, username, scan, (blurry, lowres, worst quality, (low quality:1.1), ugly, (bad anatomy:1.05), artist name, (patreon username:1.2)
27
+ output:
28
+ url: stand_on_ripplewater.jpeg
29
+ ---
30
+
31
+ # MIDNIGHT_NAI-XL_vPredV1
32
+
33
+ **Model Type:** Diffusion-based text-to-image generative model
34
+
35
+ **Base Model:** [MIDNIGHT_NAI-XL_vPredV1](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1)
36
+
37
+ **License:** [CreativeML Open RAIL++-M](https://github.com/CompVis/stable-diffusion/blob/main/LICENSE)
38
+
39
+ ## Model Description
40
+
41
+ MIDNIGHT_NAI-XL_vPredV1 is a specialized fine-tuning of the MIDNIGHT_NAI-XL_vPredV1 (NAI-XL) model, designed to enhance realistic precision, compositional coherence, and versatile style integration. This model excels in generating high-quality realistic images with vibrant colors while minimizing overexposure.
42
+
43
+ ## Usage Recommendations
44
+
45
+ ### **Sampling Methods**
46
+ MIDNIGHT_NAI-XL_vPredV2 is optimized specifically for **Euler (normal)**.
47
+ Use **ModelSamplingDiscrete** with **V-prediction** and **ZsNR set to true**.
48
+ Other samplers may not provide stable results, and **V-prediction models do not support other samplers**.
49
+
50
+ ### **CFG Scaling**
51
+ **Dynamic CFG Plugin is bypassed as a backup for potential future needs.**
52
+ Manually adjust **CFG scaling within a range of 5-6** for the best balance.
53
+ For optimal results, a **preferred setting of 5.3** is recommended.
54
+
55
+ ### **Custom Workflow**
56
+ For an optimized generation process, use the [**MIDNIGHT1111_Chasm 2025-02-04**](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/MIDNIGHT1111_Chasm%202025-02-04.json) ComfyUI workflow.
57
+ This workflow is specifically designed to **leverage the strengths of MIDNIGHT_NAI-XL_vPredV1**, providing a streamlined and efficient image generation pipeline.
58
+
59
+
60
+ ## MIDNIGHT1111_Chasm
61
+
62
+ For an optimized generation process, consider using the custom workflow [`MIDNIGHT1111_Chasm 2025-02-04.json`](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/MIDNIGHT1111_Chasm%202025-02-04.json). This workflow is tailored to leverage the strengths of the MIDNIGHT_NAI-XL_vPredV1 model, providing a streamlined and efficient image generation pipeline.
63
+
64
+ ![MIDNIGHT1111_Chasm Workflow](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/resolve/main/MIDNIGHT1111_Chasm%20Workflow.png)
65
+
66
+ *Note: The above image is a preview of the `MIDNIGHT1111_Chasm` workflow.*
67
+
68
+ ## Trigger Word Lists
69
+
70
+ To enhance the model's performance and specificity, the following trigger word lists are included:
71
+
72
+ - [`danbooru_artist_webui.csv`](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/danbooru_artist_webui.csv)
73
+ - [`danbooru_character_webui.csv`](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/danbooru_character_webui.csv)
74
+ - [`e621_artist_webui.csv`](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/e621_artist_webui.csv)
75
+ - [`e621_character_webui.csv`](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/e621_character_webui.csv)
76
+
77
+ These lists provide recognized tags for various artists and characters, facilitating more accurate and tailored image generation.
78
+
79
+ ## How to Use
80
+
81
+ ### Method I: reForge
82
+
83
+ 1. **Installation:** If not already installed, follow the instructions in the [reForge repository](https://github.com/Panchovix/stable-diffusion-webui-reForge) to set up.
84
+ 2. **Usage:** Launch WebUI and use the model as usual.
85
+
86
+ ### Method II: ComfyUI
87
+
88
+ 1. **Installation:** Follow the setup instructions in the [ComfyUI repository](https://github.com/comfyanonymous/ComfyUI).
89
+ 2. **Workflow Sample:** Utilize the provided [ComfyUI workflow sample](https://huggingface.co/MidnightRunner/MIDNIGHT_NAI-XL_vPredV1/blob/main/MIDNIGHT1111_Chasm%202025-02-04.json) for guidance.
90
+
91
+ ### Method III: WebUI
92
+
93
+ 1. **Installation:** Follow the instructions in the [WebUI repository](https://github.com/AUTOMATIC1111/stable-diffusion-webui) to set up.
94
+ Switch to dev branch:
95
+ git switch dev
96
+
97
+ Follow the setup instructions in the [WebUI repository](https://github.com/AUTOMATIC1111/stable-diffusion-webui)."
98
+
99
+ 2. **Navigate to the WebUI Directory:** Before updating or switching branches, ensure you're inside the `stable-diffusion-webui` folder
100
+ command: |
101
+ ```bash
102
+ cd stable-diffusion-webui
103
+ ```
104
+
105
+ 3. **Switch to the Development Branch (Optional, for testing new features):** If you want to use the latest features from the development branch, run:
106
+ command: |
107
+ ```bash
108
+ git switch dev
109
+ git pull
110
+ ```
111
+ ⚠️ **Note:** The `dev` branch may contain bugs. If stability is your priority, it's best to stay on the `main` branch.
112
+
113
+ 4. **Update WebUI (Main or Dev Branch):** To pull the latest updates while on either branch, run:
114
+ command: |
115
+ ```bash
116
+ git pull
117
+ ```
118
+ 🔄 **Restart WebUI after updating to apply changes.**"
119
+
120
+ 5. **Configuration:** Ensure you're using a stable branch, as the dev branch may contain bugs.
121
+
122
+ ### Method IV: Diffusers
123
+
124
+ ```bash
125
+ import torch
126
+ from diffusers import StableDiffusionXLPipeline
127
+ from diffusers import EulerDiscreteScheduler
128
+
129
+ ckpt_path = "/path/to/model.safetensors"
130
+ pipe = StableDiffusionXLPipeline.from_single_file(
131
+ ckpt_path,
132
+ use_safetensors=True,
133
+ torch_dtype=torch.float16,
134
+ )
135
+ scheduler_args = {"prediction_type": "v_prediction", "rescale_betas_zero_snr": True}
136
+ pipe.scheduler = EulerDiscreteScheduler.from_config(pipe.scheduler.config, **scheduler_args)
137
+ pipe.enable_xformers_memory_efficient_attention()
138
+ pipe = pipe.to("cuda")
139
+
140
+ prompt = """masterpiece, best quality,artist:john_kafka,artist:nixeu,artist:quasarcake, chromatic aberration, film grain, horror \(theme\), limited palette, x-shaped pupils, high contrast, color contrast, cold colors, arlecchino \(genshin impact\), black theme, gritty, graphite \(medium\)"""
141
+ negative_prompt = "nsfw, worst quality, old, early, low quality, lowres, signature, username, logo, bad hands, mutated hands, mammal, anthro, furry, ambiguous form, feral, semi-anthro"
142
+
143
+ image = pipe(
144
+ prompt=prompt,
145
+ negative_prompt=negative_prompt,
146
+ width=832,
147
+ height=1216,
148
+ num_inference_steps=28,
149
+ guidance_scale=5,
150
+ generator=torch.Generator().manual_seed(42),
151
+ ).images[0]
152
+
153
+ image.save("output.png")
154
+ ```
155
+
156
+ ## Acknowledgments
157
+
158
+ Special thanks to:
159
+
160
+ - **Development Team:** Laxhar Lab
161
+ - **Coding Contributions:** Euge
162
+ - **Community Support:** Various contributors
163
+
164
+ ## Additional Resources
165
+
166
+ - **Guidebook for NoobAI XL:** [English Version](https://civitai.com/articles/8962)
167
+ - **Recommended LoRa List for NoobAI XL:** [Resource Link](https://fcnk27d6mpa5.feishu.cn/wiki/IBVGwvVGViazLYkMgVEcvbklnge)
168
+ - **Fixing Black Images in ComfyUI on macOS (M1/M2):** [Read the Article](https://civitai.com/articles/11106)
169
+ - **Creative Solutions and Services:** [Magnabos.co](https://magnabos.co/)
170
+
171
+ ## License
172
+
173
+ This model is licensed under the [CreativeML Open RAIL++-M License](https://github.com/CompVis/stable-diffusion/blob/main/LICENSE). By using this model, you agree to the terms and conditions outlined in the license.