README.md

---
license: creativeml-openrail-m
datasets:
- FredZhang7/disco-diffusion
tags:
- text-to-image
- stable-diffusion
- disco-diffusion
- painting
- art
inference: true
---
## Paint Journey V1 is Dreamlike Diffusion V1 fine-tuned on 260 hand-picked watercolor and digital paintings generated by [Disco Diffusion](https://github.com/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb)

Used Linux Dreambooth to teach the model to generate more artistic watercolor and digital paintings. Just use the same prompts you would for stable diffusion v1.5, but add **disco** at the start to use this style.
To get started, try using dimensions around 768x768 for anything, 768x896 for portraits, and 1088x768 for landscapes. Or, you can stick with [Dreamlike Diffusion](https://huggingface.co/dreamlike-art/dreamlike-diffusion-1.0) dimensions.

## Professional Painting

Check out [Paint Journey V2](https://huggingface.co/FredZhang7/paint-journey-v2)! Its artwork is characterized by intricate details, vibrant colors, and light that brings artwork to life.

## Portrait Examples

![](./example_discobeautifulyounglady_portrait.png)

![](./example_discoyoungman_portrait.png)

## Landscape Examples

![](./example_discofuturisticcity.png)

![](./example_discocityoilpainting.png)

![](./example_discolandneartheocean.png)

![](./example_discomountain_landscape.png)

## Outerspace Examples

![](./example_discoalienworld_landscape.png)

![](./example_discodreamlikeartgalaxy.png)

![](./example_discodreamlikeartuniverse.png)



Prompts from top to bottom:

<details>
<summary> Click to expand </summary>

```
a disco painting of a happy young lady, gorgeous beautiful hair, ((beautiful eyes)), medium shot, high resolution wallpaper
Negative prompt: low-res blurry deformed mutated body (((duplicate faces))) (((double head))) (((long neck))) bad anatomy long face extra fingers text watermark
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 895783426, Size: 768x928, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
a disco painting of a young man, smiling, beautiful eyes, half body, high resolution wallpaper
Negative prompt: low-res blurry deformed mutated body ((duplicate faces)) ((double head)) bad anatomy long face long neck extra fingers text watermark signature
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 1616995491, Size: 768x936, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
((disco futuristic city)), dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry deformed fog
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3950043173, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco city, oil and canvas painting, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3015312670, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco land near the ocean, watercolor painting, sunset, high resolution wallpaper
Negative prompt: low-res blurry deformed smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3299930008, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco oil painting of a mountain, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 753552356, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco beautiful landscape in an alien world, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3582670051, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco galaxy, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry smoke sphere
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 386090498, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco universe, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 2520017543, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```

</details>

<br>


## Automatic1111's WebUI
```
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
```
Download [paint_journey.ckpt](./paint_journey.ckpt) to the `./stable-diffusion-webui/models/Stable-diffusion` folder. Run `webui-user.bat`.

## Diffusers
```bash
pip install --upgrade diffusers
```
```python
from diffusers import StableDiffusionPipeline
import torch

pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v1")
pipe = pipe.to("cuda")

prompt = "disco lighthouse near the sea, oil painting, high resolution wallpaper"
image = pipe(prompt).images[0]

image.save("./result.png")
```

## Safety Checker

The official [stable diffusion safety checker](https://huggingface.co/CompVis/stable-diffusion-safety-checker) uses up 1.22GB VRAM. Recommend using [Google Safesearch Mini](https://huggingface.co/FredZhang7/google-safesearch-mini) (99MB) to save 1.12GB VRAM.