Hugging Face's logo

FredZhang7
/
paint-journey-v2

Text-to-Image
Diffusers
English
StableDiffusionPipeline
midjourney
stable-diffusion
disco-diffusion
art
arxiv:2208.12242
Inference Endpoints
Model card Files Community
3
paint-journey-v2
File size: 4,502 Bytes 
46a65ff
 
93ad14d
 
 
 
 
 
 
 
 
46a65ff
849e631
93ad14d
 
 
1378a3d
552bcab
1378a3d
552bcab
 
 
 
 
 
 
 
 
 
 
 
69f8d9a
 
552bcab
 
 
 
 
 
69f8d9a
 
 
552bcab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69f8d9a
 
 
 
 
552bcab
 
 
 
 
 
 
 
 
 
69f8d9a
 
 
93ad14d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9a0dcfe
93ad14d
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
 
---
license: creativeml-openrail-m
language:
- en
tags:
- text-to-image
- stable-diffusion
- disco-diffusion
- painting
- art
inference: true
---
## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion

Put **((oil painting))** at the start of the prompt for the style effect. For starters, try a dimension of 768x768 for anything, 512x768 for portraits, and 1056x768 for landscapes.


## Portrait Examples

![](./example_opmodel.png)

![](./example_opathlete.png)

## Landscape Examples

![](./example_oplighthouse.png)

![](./example_lushvalley.png)

![](./example_nighttime.png)

![](./example_opalienworld.png)

## Outerspace Examples

![](./example_opmilkyway.png)

![](./example_opuniverse.png)

![](./example_opspacestation.png)

Prompts from top to bottom:

```
((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
Steps: 20, Sampler: Euler a, CFG scale: 7.5, Seed: 874776980, Size: 512x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), portrait of a handsome young man, small smile, athlete, ((beautiful eyes)), high resolution, uhd wallpaper
Negative prompt: low-res blurry fog mutated body naked ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
Steps: 20, Sampler: Euler a, CFG scale: 7.5, Seed: 2389251230, Size: 512x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), lighthouse near the sea, high resolution wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 353450032, Size: 768x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a lush valley with mountains in the background, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 65984537, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a forest, moon, dark, night, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4247689747, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), stunning landscape in an alien world, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 3693048118, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), the milky way, high resolution, uhd wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 3904195208, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), the universe, high resolution wallpaper
Negative prompt: low-res blurry fog watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 432451301, Size: 768x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```
```
((oil painting)), a futuristic space station, lighting, sci-fi, dry paint, high resolution, uhd wallpaper
Negative prompt: low-res blurry ((fog)) watermark
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
```

## WebUI Usage
```
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
```
Download [paint_journey_v2.ckpt](./paint_journey_v2.ckpt) to the `./stable-diffusion-webui/models/Stable-diffusion` folder. Run `webui-user.bat`.

## Diffusers Usage
```bash
pip install --upgrade diffusers
```
```python
from diffusers import StableDiffusionPipeline
import torch

pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
pipe = pipe.to("cuda")

prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd wallpaper"
image = pipe(prompt).images[0]

image.save("./result.png")
```

## Safety Checker

The official [stable diffusion safety checker](https://huggingface.co/CompVis/stable-diffusion-safety-checker) uses up 1.22GB VRAM. Recommend using [Google Safesearch Mini](https://huggingface.co/FredZhang7/google-safesearch-mini) (99MB) to save 1.12GB VRAM.