flankechen
commited on
Commit
•
c7c0372
1
Parent(s):
ebdbbba
update readme and show case
Browse files- README.md +27 -0
- assets/images/cat_1.jpg +0 -0
- assets/images/cat_2.jpg +0 -0
- assets/images/cat_3.jpg +0 -0
- assets/images/cat_4.jpg +0 -0
- assets/images/cat_5.jpg +0 -0
- ip_adapter-plus_cat_demo.ipynb +0 -0
- showcase-1.jpg +0 -0
- showcase.jpg +0 -0
README.md
CHANGED
@@ -1,3 +1,30 @@
|
|
1 |
---
|
|
|
|
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
tags:
|
3 |
+
- text-to-image
|
4 |
+
- stable-diffusion
|
5 |
license: apache-2.0
|
6 |
---
|
7 |
+
|
8 |
+
# Cat Face IP-Adapter Model Card
|
9 |
+
Cat Face IP-Adapter, fine-tuned IP-Adapter plus SD1.5 for cat face.
|
10 |
+
This model is train with base "runwayml/stable-diffusion-v1-5" and [ip-adapter-plus_sd15.bin](https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin) with around 9k cat face images.
|
11 |
+
Better cat face identity than origin ip-adapter plus, plus face.
|
12 |
+
|
13 |
+
![Alt text](showcase.jpg)
|
14 |
+
|
15 |
+
## Install
|
16 |
+
Same as [IP-Adapter](https://github.com/tencent-ailab/IP-Adapter).
|
17 |
+
Same usage as plus sd15 model, just check [ip_adapter-plus_demo](https://github.com/tencent-ailab/IP-Adapter/blob/main/ip_adapter-plus_demo.ipynb)
|
18 |
+
## Models
|
19 |
+
### Image Encoder
|
20 |
+
Same with [ip-adapter-plus_sd15.bin](https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin)
|
21 |
+
|
22 |
+
- [models/image_encoder](https://huggingface.co/h94/IP-Adapter/tree/main/models/image_encoder): [OpenCLIP-ViT-H-14](https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K) with 632.08M parameter
|
23 |
+
|
24 |
+
### Cat Face IP-Adapter for SD 1.5
|
25 |
+
- [ip_adapter_plus_cat_60k_sd15.bin](https://huggingface.co/flankechen/cat_face_ipadapter/blob/main/ip_adapter_plus_cat_60k_sd15.bin)
|
26 |
+
## BadCase
|
27 |
+
- calico cats, complex texture cats face identity.
|
28 |
+
- trained with crop cat face image as ipadapter image. bad crop result, background texture harms to generation.
|
29 |
+
- OK in txt2image, not good at inpaint.
|
30 |
+
![Alt text](showcase-1.jpg)
|
assets/images/cat_1.jpg
ADDED
assets/images/cat_2.jpg
ADDED
assets/images/cat_3.jpg
ADDED
assets/images/cat_4.jpg
ADDED
assets/images/cat_5.jpg
ADDED
ip_adapter-plus_cat_demo.ipynb
ADDED
The diff for this file is too large to render.
See raw diff
|
|
showcase-1.jpg
ADDED
showcase.jpg
ADDED