first
Browse files
README.md
CHANGED
@@ -1,3 +1,106 @@
|
|
1 |
---
|
2 |
license: other
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: other
|
3 |
+
base_model: diffusers/stable-diffusion-xl-base-1.0
|
4 |
+
tags:
|
5 |
+
- stable-diffusion-xl
|
6 |
+
- stable-diffusion-xl-diffusers
|
7 |
+
- stable-diffusion
|
8 |
+
- text-to-image
|
9 |
+
- diffusers
|
10 |
+
- lora
|
11 |
+
- ffai
|
12 |
+
inference: true
|
13 |
+
widget:
|
14 |
+
- text: >-
|
15 |
+
a dog in colorful exploding clouds, dreamlike surrealism colorful smoke and
|
16 |
+
fire coming out of it, explosion of data fragments, exploding
|
17 |
+
background,realistic explosion, 3d digital art
|
18 |
+
example_title: Dogo FFusion
|
19 |
+
- text: >-
|
20 |
+
a sprinkled donut sitting on top of a table, colorful hyperrealism,
|
21 |
+
everything is made of candy, hyperrealistic digital painting, covered in
|
22 |
+
sprinkles and crumbs, vibrant colors hyper realism,colorful smoke explosion
|
23 |
+
background
|
24 |
+
example_title: Donut FFusion
|
25 |
+
- text: >-
|
26 |
+
a cup of coffee with a tree in it, surreal art, awesome great composition,
|
27 |
+
surrealism, ice cubes in tree, colorful clouds, perfectly realistic yet
|
28 |
+
surreal
|
29 |
+
example_title: CoFFee FFusion
|
30 |
+
- text: >-
|
31 |
+
brightly colored headphones with a splash of colorful paint splash, vibing
|
32 |
+
to music, stunning artwork, music is life, beautiful digital artwork,
|
33 |
+
concept art, cinematic, dramatic, intricate details, dark lighting
|
34 |
+
example_title: Headset FFusion
|
35 |
+
- text: >-
|
36 |
+
high-quality game character digital design, Unreal Engine, Water color
|
37 |
+
painting, Mecha- Monstrous high quality game fantasy rpg character design,
|
38 |
+
dark rainbow Fur Scarf, inside of a Superficial Outhouse, at Twilight,
|
39 |
+
Overdetailed art
|
40 |
+
example_title: Digital Fusion
|
41 |
+
language:
|
42 |
+
- en
|
43 |
+
thumbnail: >-
|
44 |
+
https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/p54u7dEP1u8en0--NMEjS.png
|
45 |
---
|
46 |
+
|
47 |
+
# FFXL400 Combined LoRA Model π
|
48 |
+
|
49 |
+
Welcome to the FFXL400 combined LoRA model repository on Hugging Face! This model is a culmination of extensive research, bringing together the finest LoRAs from the [400GB-LoraXL repository](https://huggingface.co/FFusion/400GB-LoraXL). Our vision was to harness the power of multiple LoRAs, meticulously analyzing and integrating a select fraction of the blocks from each.
|
50 |
+
|
51 |
+
## π¦ Model Highlights
|
52 |
+
|
53 |
+
- **Innovative Combination**: This model is a strategic integration of LoRAs, maximizing the potential of each while creating a unified powerhouse.
|
54 |
+
- **Versatility**: The model is available in various formats including diffusers, safetensors (both fp 16 and 32), and an optimized ONNIX FP16 version for DirectML, ensuring compatibility across AMD, Intel, Nvidia, and more.
|
55 |
+
- **Advanced Research**: Leveraging the latest in machine learning research, the model represents a state-of-the-art amalgamation of LoRAs, optimized for performance and accuracy.
|
56 |
+
|
57 |
+
## π Technical Insights
|
58 |
+
|
59 |
+
This model is a testament to the advancements in the field of AI and machine learning. It was crafted with precision, ensuring that:
|
60 |
+
|
61 |
+
- Only a small percentage of the blocks from the original LoRAs (UNet and text encoders) were utilized.
|
62 |
+
- The model is primed not just for inference but also for further training and refinement.
|
63 |
+
- It serves as a benchmark for testing and understanding the cumulative impact of multiple LoRAs when used in concert.
|
64 |
+
|
65 |
+
## π¨ Usage
|
66 |
+
|
67 |
+
The FFXL400 model is designed for a multitude of applications. Whether you're delving into research, embarking on a new project, or simply experimenting, this model serves as a robust foundation. Use it to:
|
68 |
+
|
69 |
+
- Investigate the cumulative effects of merging multiple LoRAs.
|
70 |
+
- Dive deep into weighting experiments with multiple LoRAs.
|
71 |
+
- Explore the nuances and intricacies of integrated LoRAs.
|
72 |
+
|
73 |
+
## π How to Use
|
74 |
+
|
75 |
+
The model can be easily integrated into your projects. Here's a quick guide on how to use the FFXL400 model:
|
76 |
+
|
77 |
+
1. **Loading the Model**:
|
78 |
+
```python
|
79 |
+
from transformers import AutoModel, AutoTokenizer
|
80 |
+
|
81 |
+
tokenizer = AutoTokenizer.from_pretrained("FFusion/FFXL400")
|
82 |
+
model = AutoModel.from_pretrained("FFusion/FFXL400")
|
83 |
+
```
|
84 |
+
|
85 |
+
2. **Performing Inference**:
|
86 |
+
```python
|
87 |
+
input_text = "Your input here"
|
88 |
+
inputs = tokenizer(input_text, return_tensors='pt')
|
89 |
+
with torch.no_grad():
|
90 |
+
outputs = model(**inputs)
|
91 |
+
```
|
92 |
+
|
93 |
+
3. **Further Training**:
|
94 |
+
You can also use the FFXL400 as a starting point for further training. Simply load it into your training pipeline and proceed as you would with any other model.
|
95 |
+
|
96 |
+
## π Background
|
97 |
+
|
98 |
+
The FFXL400 is built upon the insights and data from the [400GB-LoraXL repository](https://huggingface.co/FFusion/400GB-LoraXL). Each LoRA in that collection was extracted using the Low-Rank Adaptation (LoRA) technique, providing a rich dataset for research and exploration. The FFXL400 is the pinnacle of that research, representing a harmonious blend of the best LoRAs.
|
99 |
+
|
100 |
+
---
|
101 |
+
|
102 |
+
We hope the FFXL400 serves as a valuable asset in your AI journey. We encourage feedback, contributions, and insights from the community to further refine and enhance this model. Together, let's push the boundaries of what's possible!
|
103 |
+
|
104 |
+
|
105 |
+
|
106 |
+
![ffusionai-logo.png](https://cdn-uploads.huggingface.co/production/uploads/6380cf05f496d57325c12194/EjDa_uGcOoH2cXM2K-NYn.png)
|