thezet
/

lora

@@ -1,202 +1,106 @@
 ---
-base_model:
-- black-forest-labs/FLUX.1-dev
-license: other
 tags:
-- template:sd-lora
 - lora
 ---
-# Model Card for Model ID
-<!-- Provide a quick summary of what the model is/does. -->
-This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
-## Model Details
-### Model Description
-<!-- Provide a longer summary of what this model is. -->
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-### Model Sources [optional]
-<!-- Provide the basic links for the model. -->
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-## Uses
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-### Direct Use
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-[More Information Needed]
-### Downstream Use [optional]
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-[More Information Needed]
-### Out-of-Scope Use
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-[More Information Needed]
-## Bias, Risks, and Limitations
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-[More Information Needed]
-### Recommendations
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-## How to Get Started with the Model
-Use the code below to get started with the model.
-[More Information Needed]
-## Training Details
-### Training Data
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-[More Information Needed]
-### Training Procedure
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-#### Preprocessing [optional]
-[More Information Needed]
-#### Training Hyperparameters
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-#### Speeds, Sizes, Times [optional]
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-[More Information Needed]
-## Evaluation
-<!-- This section describes the evaluation protocols and provides the results. -->
-### Testing Data, Factors & Metrics
-#### Testing Data
-<!-- This should link to a Dataset Card if possible. -->
-[More Information Needed]
-#### Factors
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-[More Information Needed]
-#### Metrics
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-[More Information Needed]
-### Results
-[More Information Needed]
-#### Summary
-## Model Examination [optional]
-<!-- Relevant interpretability work for the model goes here -->
-[More Information Needed]
-## Environmental Impact
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-## Technical Specifications [optional]
-### Model Architecture and Objective
-[More Information Needed]
-### Compute Infrastructure
-[More Information Needed]
-#### Hardware
-[More Information Needed]
-#### Software
-[More Information Needed]
-## Citation [optional]
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-**BibTeX:**
-[More Information Needed]
-**APA:**
-[More Information Needed]
-## Glossary [optional]
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-[More Information Needed]
-## More Information [optional]
-[More Information Needed]
-## Model Card Authors [optional]
-[More Information Needed]
-## Model Card Contact
-[More Information Needed]

 ---
 tags:
+- text-to-image
+- stable-diffusion
 - lora
+- diffusers
+- template:sd-lora
+widget:
+- text: >-
+    c0m1c style vintage comic cover of a psychic woman sitting at a covered red
+    table,  in a haunting manor scene, the illustration style is macabre,
+    candles in the bacground over a mantle, the psychic is hovering her hands
+    over a purple crystal ball. Title test reads "Tales from the Flux" in an
+    eerie type face. In the lower corner show a price of 15 cents and the date
+    SEP 2024
+  output:
+    url: images/ComfyUI_09868_.png
+- text: >-
+    c0m1c style vintage 1930s style comic strip panel of a rich old man wearing
+    a top hat and dapper suit deep in thought, thinking with a thought bubble
+    that reads "No FLUX were given?"
+  output:
+    url: images/ComfyUI_temp_ipugi_00131_.png
+- text: >-
+    c0m1c style comic book strip panel of two men having a staring contest in a
+    bar, pop art style, with the thought bubble sayings "Blink." and "You
+    first."
+  output:
+    url: images/ComfyUI_temp_ipugi_00079_.png
+- text: >-
+    c0m1c style comic book strip panel of a glam 1980s superhero woman, with the
+    speech bubble saying "My spirit animal is a WiFi symbol!" purple wifi icon
+    on her chest
+  output:
+    url: images/ComfyUI_temp_ipugi_00071_.png
+- text: >-
+    c0m1c style comic book strip 2 panels of a woman laughing hysterically,
+    1950s living room. In the first panel one speech bubble "And then he said he
+    uses SD3!" over the head of a woman telling her friends a funny joke   In
+    the second panel there are multiple speech bubbles over each woman's head
+    with the words "HAHA" in various ways, their heads are tilted back in heavy
+    laughter.
+  output:
+    url: images/ComfyUI_temp_ipugi_00085_.png
+- text: >-
+    c0m1c style comic book strip panel of a woman in her living room glam style,
+    with the speech bubble saying "There's no place like latent space."
+    everything is pink including her dress
+  output:
+    url: images/ComfyUI_temp_ipugi_00076_.png
+- text: >-
+    c0m1c style comic book strip panel of a superhero, with the speech bubble
+    saying "I am Captain Flux!" with a big black F emblem on his chest
+  output:
+    url: images/ComfyUI_temp_ipugi_00068_.png
+- text: >-
+    c0m1c style comic strip panel  of a pop art woman fashion model, side
+    profile, speech above says "OH FLUX!"
+  output:
+    url: images/ComfyUI_temp_ipugi_00040_.png
+- text: >-
+    c0m1c style woman with red hair in a laundry room, vintage illustrated ad
+    for laundry detergent the brand name is FLUX in orange letters the
+    pre-heading above the logo reads "Where clean clothes meet clean pixels."
+    The woman is holding a laundry baskest with folded clothes and smiling in
+    bliss.
+  output:
+    url: images/ComfyUI_09863_.png
+base_model: black-forest-labs/FLUX.1-dev
+instance_prompt: c0m1c, comic book panel
+license: creativeml-openrail-m
 ---
+# Retro Comic Flux
+<Gallery />
+## Model description
+Retro Comic Flux is a Flux LoRA trained on a dataset consisting entirely of public domain images manually sourced, cropped and enhanced. I used ~50 images 3 repeats 15 epochs and 0.0001 learning rate. These were all captioned using Joy Caption Batch.
+This is very experimental and I had a difficult time sourcing high quality images of animals and vehicles in this style, so for now it&#39;s primarily good with human figures. It work best when you describe the character and a scene for a backdrop. It struggles with hands and eyes sometimes. If something is really not in the dataset it defaults to an ordinary AI illustration style.
+USE DEIS SAMPLER FOR THE BEST RESULTS.
+I used very similar settings as I have with my previous LoRAs so I won&#39;t go into detail for the sake of my time and brevity, low learning rates with less repeats and good data work best for simple styles.
+I was careful in my selection of images and preprocessed each image in Photoshop to bring out vivid colors, reduce the yellowing and boost contrast. This helped me to maintain a consistent coloring and I believe it improved the training quality. When I did this I also removed the speech from speech bubbles from some of the training data for more flexibility and to help Flux understand context. You can explicitly state &quot;empty speech bubble&quot; in your prompts and it tends to work. If you want to dive in deeper try using an image captioner to describe a style you want to emulate, the images have rich captions and the model responds well to natural language.
+Definitely expect a V2 of this LoRA soon, I have some ideas on how I can improve consistency but I need to find more varied source images.
+Trigger keyword: &#39;c0m1c&#39; &#39;comic book panel&#39;
+Recommended strengths: 0.7 - 0.9
+## Trigger words
+You should use `Ce` to trigger the image generation.
+You should use `comic book panel` to trigger the image generation.
+## Download model
+Weights for this model are available in Safetensors format.
+[Download](/renderartist/retrocomicflux/tree/main) them in the Files & versions tab.