Update README.md
Browse files
README.md
CHANGED
@@ -277,30 +277,45 @@ extra_gated_fields:
|
|
277 |
---
|
278 |
|
279 |
# FFXL Model Card
|
|
|
|
|
|
|
|
|
|
|
|
|
280 |
|
281 |
-
## Model
|
282 |
|
|
|
|
|
|
|
283 |
|
284 |
-
FFXL consists of a two-step pipeline for latent diffusion:
|
285 |
First, we use a base model to generate latents of the desired output size.
|
286 |
In the second step, we use a specialized high-resolution model and apply a technique called SDEdit (https://arxiv.org/abs/2108.01073, also known as "img2img")
|
287 |
to the latents generated in the first step, using the same prompt.
|
288 |
|
289 |
### Model Description
|
290 |
|
291 |
-
- **
|
292 |
- **Model type:** Diffusion-based text-to-image generative model
|
293 |
- **License:** [FFXL Research License](https://huggingface.co/FFusion/FFusionXL-09-SDXL/blob/main/LICENSE.md)
|
294 |
-
- **Model Description:** This is a model that can be used to generate and modify images based on text prompts. It is a [Latent Diffusion Model](https://arxiv.org/abs/2112.10752) that uses two fixed, pretrained text encoders ([OpenCLIP-ViT/G](https://github.com/mlfoundations/open_clip) and [CLIP-ViT/L](https://github.com/openai/CLIP/tree/main)).
|
295 |
-
- **Resources for more information:** [
|
296 |
|
297 |
### Model Sources
|
298 |
|
299 |
-
- **
|
300 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
301 |
|
302 |
-
### 🧨 Diffusers
|
303 |
|
|
|
|
|
304 |
Make sure to upgrade diffusers to >= 0.18.0:
|
305 |
```
|
306 |
pip install diffusers --upgrade
|
@@ -341,7 +356,7 @@ instead of `.to("cuda")`:
|
|
341 |
```
|
342 |
|
343 |
## Uses
|
344 |
-
|
345 |
### Direct Use
|
346 |
|
347 |
The model is intended for research purposes only. Possible research areas and tasks include
|
@@ -374,14 +389,19 @@ While the capabilities of image generation models are impressive, they can also
|
|
374 |
**Attribution:**
|
375 |
|
376 |
"SDXL 0.9 is licensed under the SDXL Research License, Copyright (c) Stability AI Ltd. All Rights Reserved."
|
377 |
-
|
378 |
## License
|
379 |
|
380 |
[SDXL 0.9 Research License](https://huggingface.co/stabilityai/stable-diffusion-xl-base-0.9/blob/main/LICENSE.md)"
|
|
|
381 |
|
|
|
382 |
|
383 |
|
|
|
|
|
|
|
384 |
|
385 |
-
|
386 |
-
|
387 |
|
|
|
|
277 |
---
|
278 |
|
279 |
# FFXL Model Card
|
280 |
+
<div style="display: flex; flex-wrap: wrap; gap: 2px;">
|
281 |
+
<img src="https://img.shields.io/badge/%F0%9F%94%A5%20Refiner%20Compatible-Yes-success">
|
282 |
+
<img src="https://img.shields.io/badge/%F0%9F%92%BB%20CLIP--ViT%2FG%20and%20CLIP--ViT%2FL%20tested-Yes-success">
|
283 |
+
</div>
|
284 |
+
|
285 |
+
[![Download](https://img.shields.io/badge/-Download%20Model-brightgreen?style=for-the-badge&logo=appveyor)](https://huggingface.co/FFusion/FFusionXL-LoRa-SDXL-Potion-Art-Engine/resolve/main/FFusionXL-LoRa-SDXL-Potion-Art-Engine.safetensors)
|
286 |
|
|
|
287 |
|
288 |
+
![FFusionAI_00187_.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/dtRkHom_cxGSzCV2ReeVc.png)
|
289 |
+
|
290 |
+
## Model
|
291 |
|
292 |
+
FFXL based on SDXL consists of a two-step pipeline for latent diffusion:
|
293 |
First, we use a base model to generate latents of the desired output size.
|
294 |
In the second step, we use a specialized high-resolution model and apply a technique called SDEdit (https://arxiv.org/abs/2108.01073, also known as "img2img")
|
295 |
to the latents generated in the first step, using the same prompt.
|
296 |
|
297 |
### Model Description
|
298 |
|
299 |
+
- **Trained by:** FFusion AI
|
300 |
- **Model type:** Diffusion-based text-to-image generative model
|
301 |
- **License:** [FFXL Research License](https://huggingface.co/FFusion/FFusionXL-09-SDXL/blob/main/LICENSE.md)
|
302 |
+
- **Model Description:** This is a trained model based on SDXL that can be used to generate and modify images based on text prompts. It is a [Latent Diffusion Model](https://arxiv.org/abs/2112.10752) that uses two fixed, pretrained text encoders ([OpenCLIP-ViT/G](https://github.com/mlfoundations/open_clip) and [CLIP-ViT/L](https://github.com/openai/CLIP/tree/main)).
|
303 |
+
- **Resources for more information:** [SDXL paper on arXiv](https://arxiv.org/abs/2307.01952).
|
304 |
|
305 |
### Model Sources
|
306 |
|
307 |
+
- **Demo:** soon
|
308 |
+
|
309 |
+
<div style="display: flex; flex-wrap: wrap; gap: 2px;">
|
310 |
+
<a href="https://huggingface.co/FFusion/FFusion-BaSE" target="_new" rel="ugc"><img src="https://img.shields.io/badge/Hugging%20Face-FFusion--BaSE-blue" alt="Hugging Face Model"></a>
|
311 |
+
<a href="https://github.com/1e-2" target="_new" rel="ugc"><img src="https://img.shields.io/badge/GitHub-1e--2-green" alt="GitHub"></a>
|
312 |
+
<a href="https://www.facebook.com/FFusionAI/" target="_new" rel="ugc"><img src="https://img.shields.io/badge/Facebook-FFusionAI-blue" alt="Facebook"></a>
|
313 |
+
<a href="https://civitai.com/models/82039/ffusion-ai-sd-21" target="_new" rel="ugc"><img src="https://img.shields.io/badge/Civitai-FFusionAI-blue" alt="Civitai"></a>
|
314 |
+
</div>
|
315 |
|
|
|
316 |
|
317 |
+
### 🧨 Diffusers
|
318 |
+
![ffusionXL.jpg](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/iM_2uykpHRQsZgLvIjJJl.jpeg)
|
319 |
Make sure to upgrade diffusers to >= 0.18.0:
|
320 |
```
|
321 |
pip install diffusers --upgrade
|
|
|
356 |
```
|
357 |
|
358 |
## Uses
|
359 |
+
![fusion.ai334.jpg](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/M9KPUbng7iMUlW4lV93_1.jpeg)
|
360 |
### Direct Use
|
361 |
|
362 |
The model is intended for research purposes only. Possible research areas and tasks include
|
|
|
389 |
**Attribution:**
|
390 |
|
391 |
"SDXL 0.9 is licensed under the SDXL Research License, Copyright (c) Stability AI Ltd. All Rights Reserved."
|
392 |
+
|
393 |
## License
|
394 |
|
395 |
[SDXL 0.9 Research License](https://huggingface.co/stabilityai/stable-diffusion-xl-base-0.9/blob/main/LICENSE.md)"
|
396 |
+
[FFXL 0.9 Research License](https://huggingface.co/FFusion/FFusionXL-09-SDXL/blob/main/LICENSE.md)"
|
397 |
|
398 |
+
[![Email](https://img.shields.io/badge/Email-di%40ffusion.ai-blue?style=for-the-badge&logo=gmail)](mailto:[email protected])
|
399 |
|
400 |
|
401 |
+
## SAMPLES
|
402 |
+
![fusion.ai_00093_.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/PxV5UTzx1AYydn9i513ot.png)
|
403 |
+
![fusion.ai_00113_.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/YlwMyrQvbxXa6KVY2ZSIQ.png)
|
404 |
|
405 |
+
![fusion.ai333.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/ZvtAL425MwNF3mFRukLc-.png)
|
|
|
406 |
|
407 |
+
![ffusion.aeei.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/OMpFvmPKiQwe46Nwbl2f9.png)
|