Upload 2 files
Browse files- .gitattributes +1 -0
- README.md +110 -0
- showcase.jpg +3 -0
.gitattributes
CHANGED
@@ -32,3 +32,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
32 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
33 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
34 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
32 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
33 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
34 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
35 |
+
showcase.jpg filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -1,3 +1,113 @@
|
|
1 |
---
|
|
|
|
|
2 |
license: creativeml-openrail-m
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
license: creativeml-openrail-m
|
5 |
+
thumbnail: "https://huggingface.co/Guizmus/SDArt_synesthesia/resolve/main/showcase.jpg"
|
6 |
+
tags:
|
7 |
+
- stable-diffusion
|
8 |
+
- text-to-image
|
9 |
+
- image-to-image
|
10 |
---
|
11 |
+
# SDArt : Synesthesia (version based on 1.5)
|
12 |
+
|
13 |
+
![Showcase](https://huggingface.co/Guizmus/SDArt_synesthesia/resolve/main/showcase.jpg)
|
14 |
+
|
15 |
+
## Theme
|
16 |
+
|
17 |
+
Dear @Challengers ,
|
18 |
+
|
19 |
+
> In a world where colors have flavor, and sounds have texture,
|
20 |
+
> The senses intertwine to create a sensory rapture.
|
21 |
+
> Welcome to “Synesthesia”- where the ordinary is extraordinary,
|
22 |
+
> And art takes on a meaning that’s truly visionary! :Rainbowpink:
|
23 |
+
|
24 |
+
Synesthesia /ˌsɪn.əsˈθiː.ʒə/: an anomalous blending of the senses in which the stimulation of one modality simultaneously produces sensation in a different modality. Synesthetes hear colors, feel sounds, and taste shapes.
|
25 |
+
|
26 |
+
* Create an image that captures the essence of synesthesia sensory! Explore the intersections of sound, color, and texture. What’s it like tasting a melody, feeling a scent, or seeing colored words?
|
27 |
+
|
28 |
+
* What would it look it look like to taste the sound of a thunderstorm? How would you visualize the sensation of feeling the warmth of the sun on your skin? Or how about tasting a particular color–such as a bright red apple or a cool blueberry?
|
29 |
+
|
30 |
+
* Explore the possibilities of synesthesia and its many interpretations!
|
31 |
+
|
32 |
+
|
33 |
+
## Model description
|
34 |
+
|
35 |
+
This is a model related to the "Picture of the Week" contest on Stable Diffusion discord..
|
36 |
+
|
37 |
+
I try to make a model out of all the submission for people to continue enjoy the theme after the even, and see a little of their designs in other people's creations. The token stays "SDArt" and I balance the learning on the low side, so that it doesn't just replicate creations.
|
38 |
+
|
39 |
+
The total dataset is made of 39 pictures. It was trained on [Stable diffusion 1.5](https://huggingface.co/runwayml/stable-diffusion-v1-5). I used [EveryDream](https://github.com/victorchall/EveryDream2trainer) to do the training, 100 total repeat per picture. The pictures were tagged using the token "SDArt", and an arbitrary token I choose. The dataset is provided below, as well as a list of usernames and their corresponding token.
|
40 |
+
|
41 |
+
The recommended sampling is k_Euler_a or DPM++ 2M Karras on 20 steps, CFGS 7.5 .
|
42 |
+
|
43 |
+
## Trained tokens
|
44 |
+
|
45 |
+
* SDArt
|
46 |
+
* dyce
|
47 |
+
* bnp
|
48 |
+
* keel
|
49 |
+
* aten
|
50 |
+
* fcu
|
51 |
+
* lpg
|
52 |
+
* mth
|
53 |
+
* elio
|
54 |
+
* gani
|
55 |
+
* pfa
|
56 |
+
* kprc
|
57 |
+
* cpec
|
58 |
+
* kuro
|
59 |
+
* asot
|
60 |
+
* psst
|
61 |
+
* sqm
|
62 |
+
* irgc
|
63 |
+
* cq
|
64 |
+
* utm
|
65 |
+
* guin
|
66 |
+
* crit
|
67 |
+
* mlas
|
68 |
+
* isch
|
69 |
+
* vedi
|
70 |
+
* dds
|
71 |
+
* acu
|
72 |
+
* oxi
|
73 |
+
* kohl
|
74 |
+
* maar
|
75 |
+
* mako
|
76 |
+
* mds
|
77 |
+
* mert
|
78 |
+
* mgt
|
79 |
+
* miki
|
80 |
+
* minh
|
81 |
+
* mohd
|
82 |
+
* mss
|
83 |
+
* muc
|
84 |
+
* mwf
|
85 |
+
|
86 |
+
## Download links
|
87 |
+
|
88 |
+
[SafeTensors](https://huggingface.co/Guizmus/SDArt_synesthesia/resolve/main/SDArt_synesthesia.safetensors)
|
89 |
+
|
90 |
+
[CKPT](https://huggingface.co/Guizmus/SDArt_synesthesia/resolve/main/SDArt_synesthesia.ckpt)
|
91 |
+
|
92 |
+
[Dataset](https://huggingface.co/Guizmus/SDArt_synesthesia/resolve/main/dataset.zip)
|
93 |
+
|
94 |
+
## 🧨 Diffusers
|
95 |
+
|
96 |
+
This model can be used just like any other Stable Diffusion model. For more information,
|
97 |
+
please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
|
98 |
+
|
99 |
+
You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
|
100 |
+
|
101 |
+
```python
|
102 |
+
from diffusers import StableDiffusionPipeline
|
103 |
+
import torch
|
104 |
+
|
105 |
+
model_id = "Guizmus/SDArt_synesthesia"
|
106 |
+
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
|
107 |
+
pipe = pipe.to("cuda")
|
108 |
+
|
109 |
+
prompt = "SDArt minh"
|
110 |
+
image = pipe(prompt).images[0]
|
111 |
+
|
112 |
+
image.save("./SDArt.png")
|
113 |
+
```
|
showcase.jpg
ADDED
![]() |
Git LFS Details
|