File size: 2,180 Bytes
63678b0 53c6067 63678b0 53c6067 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 |
---
license: mit
base_model: stabilityai/stable-diffusion-xl-base-1.0
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
- diffusers
- lora
inference: true
---
# sdxl-ugly-sonic-lora
A LoRA for SDXL 1.0 Base which generates Ugly Sonic, using `sonic the hedgehog` as the trigger keywords.
## Usage
The LoRA can be loaded using `load_lora_weights` like any other LoRA in `diffusers`:
```py
import torch
from diffusers import DiffusionPipeline, AutoencoderKL
vae = AutoencoderKL.from_pretrained(
"madebyollin/sdxl-vae-fp16-fix",
torch_dtype=torch.float16
)
base = DiffusionPipeline.from_pretrained(
"stabilityai/stable-diffusion-xl-base-1.0",
vae=vae,
torch_dtype=torch.float16,
variant="fp16",
use_safetensors=True
)
base.load_lora_weights("minimaxir/sdxl-ugly-sonic-lora")
_ = base.to("cuda")
```
During image generation, use `sonic the hedgehog` in the prompt.
## Examples
For all generations, the negative prompt used is `blurry, low quality`.
`a close up of sonic the hedgehog (smiling for the camera with a toothy grin)++++, hyperrealistic photo for national geographic` (cfg = 13)
![](img/example1.webp)
`sonic the hedgehog relaxing on a couch, renaissance painting, (oil on canvas, aged, worn)++++` (cfg = 13)
![](img/example2.webp)
`a profile of sonic the hedgehog sitting at a desk deep in thought, (pixel art)++++, award-winning photo for vanity fair` (cfg = 13)
![](img/example3.webp)
`anatomical diagram of sonic the hedgehog, (highly detailed)++++` (cfg = 13)
![](img/example4.webp)
`sonic the hedgehog (eating at McDonald's)++, Ukiyo-e, minimalistic vector art` (cfg = 13)
![](img/example5.webp)
## Methodology
This LoRA was trained on frame-by-frame analysis of the [original 1080p trailer](https://www.youtube.com/watch?v=4mW9FE5ILJs) featuring "Ugly Sonic". Square-crops of Ugly Sonic were extracted and AI-upscaled to 1080p.
The use of `sonic the hedgehog` as the trigger keywords ensures that you won't generate the _other_ hedgehog by accident.
## Notes
- The CGI style of Ugly Sonic may overpower other style prompts. Therefore, you should weight any style prompts much higher.
|