File size: 2,180 Bytes
63678b0
 
53c6067
 
 
 
 
 
 
 
63678b0
53c6067
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
---
license: mit
base_model: stabilityai/stable-diffusion-xl-base-1.0
tags:
  - stable-diffusion
  - stable-diffusion-diffusers
  - text-to-image
  - diffusers
  - lora
inference: true
---

# sdxl-ugly-sonic-lora

A LoRA for SDXL 1.0 Base which generates Ugly Sonic, using `sonic the hedgehog` as the trigger keywords.

## Usage

The LoRA can be loaded using `load_lora_weights` like any other LoRA in `diffusers`:

```py
import torch
from diffusers import DiffusionPipeline, AutoencoderKL

vae = AutoencoderKL.from_pretrained(
    "madebyollin/sdxl-vae-fp16-fix",
    torch_dtype=torch.float16
)
base = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    vae=vae,
    torch_dtype=torch.float16,
    variant="fp16",
    use_safetensors=True
)

base.load_lora_weights("minimaxir/sdxl-ugly-sonic-lora")

_ = base.to("cuda")
```

During image generation, use `sonic the hedgehog` in the prompt.

## Examples

For all generations, the negative prompt used is `blurry, low quality`.

`a close up of sonic the hedgehog (smiling for the camera with a toothy grin)++++, hyperrealistic photo for national geographic` (cfg = 13)

![](img/example1.webp)

`sonic the hedgehog relaxing on a couch, renaissance painting, (oil on canvas, aged, worn)++++` (cfg = 13)

![](img/example2.webp)

`a profile of sonic the hedgehog sitting at a desk deep in thought, (pixel art)++++, award-winning photo for vanity fair` (cfg = 13)

![](img/example3.webp)

`anatomical diagram of sonic the hedgehog, (highly detailed)++++` (cfg = 13)

![](img/example4.webp)

`sonic the hedgehog (eating at McDonald's)++, Ukiyo-e, minimalistic vector art` (cfg = 13)

![](img/example5.webp)

## Methodology

This LoRA was trained on frame-by-frame analysis of the [original 1080p trailer](https://www.youtube.com/watch?v=4mW9FE5ILJs) featuring "Ugly Sonic". Square-crops of Ugly Sonic were extracted and AI-upscaled to 1080p.

The use of `sonic the hedgehog` as the trigger keywords ensures that you won't generate the _other_ hedgehog by accident.

## Notes

- The CGI style of Ugly Sonic may overpower other style prompts. Therefore, you should weight any style prompts much higher.