Hugging Face's logo

lichorosario
/
flux-lora-rtmi

Text-to-Image
Diffusers
English
flux
lora
replicate
Model card Files Community
1
flux-lora-rtmi / README.md
lichorosario's picture
lichorosario
Update README.md
482a98c verified
preview code
|
raw
history blame
3.77 kB
metadata
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
language:
  - en
tags:
  - flux
  - diffusers
  - lora
  - replicate
base_model: black-forest-labs/FLUX.1-dev
pipeline_tag: text-to-image
instance_prompt: RTMI
library_name: diffusers
inference:
  parameters:
    width: 1536
    height: 768
widget:
  - text: >-
      RTMI style. Guybrush threepwood,  a tall man with blonde hair, wearing a
      blue pirate coat with gold accents. He has a white shirt underneath, a
      belt with a gold buckle, and dark pants. His expression is thoughtful, and
      he has a slight stubble on his face, adding to his adventurous appearance.
      Guybrush is programming with many computers. Cyberpunk style.
    example_title: Guybrush programmer
    output:
      url: samples/guybrush-programmer.png
  - text: >-
      RTMI style. An empty interior scene just inside the entrance of a towering
      building constructed and inhabited by cockroaches. The perspective is
      distorted and cartoonish, with the camera positioned as if you're standing
      just past the grand, slightly arched door that leads into the building.
      The interior is a labyrinth of narrow, winding corridors that twist and
      turn unpredictably, with passageways leading up, down, and in all
      directions, creating a sense of disorientation. The ceiling, walls, and
      floors are all pristine white, with the floor retroilluminated, casting a
      soft glow upwards. The hallways have a sleek, futuristic appearance, but
      are still dimly lit, with shadows that accentuate the strange angles of
      the walls. The retro-style TVs embedded in the walls have bright orange
      plastic casings, while the screens emit a soft, white light. The screens
      are tilted at odd angles, flickering with static or displaying quirky,
      old-school TV shows, adding a nostalgic glow to the cold environment. The
      staircases are modern and minimalist, without handrails, their black steps
      creating a stark contrast against the white surroundings. The stairs
      spiral upward in erratic directions, some leading to higher floors, while
      others abruptly end in dead ends. The stairways are crooked, with steps of
      varying heights and widths, enhancing the building’s surreal, disjointed
      atmosphere. The white walls are adorned with subtle, recessed cockroach
      logos, creating an embossed effect that adds texture and detail to the
      otherwise smooth surfaces. Additional doors are scattered throughout the
      corridor, some leading to hidden rooms, while others open into completely
      dark tunnels. The hallways also bifurcate in places, with some passages
      leading into these pitch-black tunnels, creating a sense of mystery and
      unease. The entire scene is bathed in a mix of dim lighting from the
      ceiling, the soft glow from the floor, and the eerie light of the orange
      TVs, creating a mysterious and slightly unsettling atmosphere.
    example_title: Tv nest
    output:
      url: samples/tv-channel.png

Flux Lora Rtmi

Trained on Replicate using:

https://replicate.com/ostris/flux-dev-lora-trainer/train

Trigger words

You should use RTMI to trigger the image generation.

Use it with the 🧨 diffusers library 

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('lichorosario/flux-lora-rtmi', weight_name='lora.safetensors')
image = pipeline('your prompt').images[0]
Prompt
RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a blue pirate coat with gold accents. He has a white shirt underneath, a belt with a gold buckle, and dark pants. His expression is thoughtful, and he has a slight stubble on his face, adding to his adventurous appearance. Guybrush is programming with many computers. Cyberpunk style.
Prompt
RTMI style. An empty interior scene just inside the entrance of a towering building constructed and inhabited by cockroaches. The perspective is distorted and cartoonish, with the camera positioned as if you're standing just past the grand, slightly arched door that leads into the building. The interior is a labyrinth of narrow, winding corridors that twist and turn unpredictably, with passageways leading up, down, and in all directions, creating a sense of disorientation. The ceiling, walls, and floors are all pristine white, with the floor retroilluminated, casting a soft glow upwards. The hallways have a sleek, futuristic appearance, but are still dimly lit, with shadows that accentuate the strange angles of the walls. The retro-style TVs embedded in the walls have bright orange plastic casings, while the screens emit a soft, white light. The screens are tilted at odd angles, flickering with static or displaying quirky, old-school TV shows, adding a nostalgic glow to the cold environment. The staircases are modern and minimalist, without handrails, their black steps creating a stark contrast against the white surroundings. The stairs spiral upward in erratic directions, some leading to higher floors, while others abruptly end in dead ends. The stairways are crooked, with steps of varying heights and widths, enhancing the building’s surreal, disjointed atmosphere. The white walls are adorned with subtle, recessed cockroach logos, creating an embossed effect that adds texture and detail to the otherwise smooth surfaces. Additional doors are scattered throughout the corridor, some leading to hidden rooms, while others open into completely dark tunnels. The hallways also bifurcate in places, with some passages leading into these pitch-black tunnels, creating a sense of mystery and unease. The entire scene is bathed in a mix of dim lighting from the ceiling, the soft glow from the floor, and the eerie light of the orange TVs, creating a mysterious and slightly unsettling atmosphere.
Prompt
RTMI style. textured paper collage The paper texture is very visible. There are different textures. The papers are handmade painted with watercolor and crayons. An empty stylized game background scene using muted colors, mainly blue, yellow, orange, black and violet. A winding path crosses the screen, curving from the top left to the bottom right. Below the path, whimsical trees with irregular, bulbous shapes and playful, swirling bushes fill the scene. To the right stands a cozy, old-fashioned restaurant with large glass windows, through which warm, soft light spills onto the empty street. Inside, simple wooden tables and chairs are arranged neatly, but the restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's exterior features a large, aged wooden sign, slightly crooked, with an oversized fork carved into it and the text "Crespín Restorán" in quirky, uneven letters. Outside, a few tufts of grass poke through the cracks of the weathered sidewalk tiles, adding to the rustic charm. The night sky above is dark, with a crescent moon shining softly, casting gentle shadows. The street is empty and lonely, illuminated by a few antique-style street lamps that emit a dim, warm light, contrasting with the cold, bluish light of the street itself. The lamps are bent and irregular, with wavy lines, and their light creates playful, wavy reflections on the pavement. The visual style in these images can be characterized as highly exaggerated and car.
Prompt
RTMI game background design. Fisheye lens panorama background for a point-and-click game. The horizon is curvy, and the scene is viewed from a low angle on a deserted beach with soft, golden sand. In the foreground, gentle waves of the deep blue ocean lap against the shore. Far in the distance, a steep cliff rises dramatically from the beach, and perched on top is a very large wooden cabin with a rustic, adventurous design. The cabin features a thatched roof and sturdy log walls in various shades of brown. A winding dirt path carves its way up the cliffside, connecting the beach with the cabin above. Below the cliff, a small wooden pier extends into the water, where a boat is gently swaying in the breeze. On the distant horizon, a small picturesque village resembling Capri is nestled on a hill, its buildings barely visible against the bright, sunny sky. The entire scene is peaceful and tranquil, with the sun casting a warm light over the landscape, while the sense of adventure lingers in the air from the towering cliff and the solitary wooden cabin above. . This visual style is defined by a strong emphasis on exaggerated forms and dynamic compositions. The shapes throughout are distorted and twisted, moving away from realistic representations and instead creating a world that feels fluid and constantly in motion. Buildings and objects often appear bent, curved, or skewed, giving the environment a surreal quality that emphasizes a playful and imaginative tone. The architecture seems to defy gravity, with structures leaning at odd angles, contributing to the overall whimsical feel. Perspective is another key aspect of this style, where traditional rules are intentionally bent or broken. Instead of using a realistic vanishing point, the perspective often resembles a wide-angle or fisheye lens, with objects stretching and warping as they recede into the distance. This creates a sense of depth that is exaggerated and immersive, drawing the viewer into the scene while maintaining a distinctly stylized and cartoonish appearance. Lighting is used to define the shapes and enhance the sense of depth and dimension. Highlights and shadows are applied in a bold, almost graphic manner, bringing out the contours of the objects and creating a strong contrast between different elements. This approach adds to the overall dynamism of the composition, making the scenes feel energetic and full of life. The compositions themselves are carefully structured to guide the viewer’s eye across the scene. The use of exaggerated perspective and distorted shapes creates a visual flow that leads from one area to another, encouraging exploration and engagement with the environment. This sense of movement within the static image helps to reinforce the idea of a world that is in constant flux, where nothing is quite as it seems. Overall, the style focuses on distortion, dynamic perspective, and strong lighting to create an engaging and surreal visual experience. The world feels lively and imaginative, with every element contributing to a cohesive and playful aesthetic that invites the viewer into its unique and fantastical universe.
Prompt
RTMI illustration style. View from a cliffside lookout, looking down towards large rocks and the ocean below. The edge of the cliff is covered in rough, gray rocks with small cracks and patches of resilient vegetation growing between them. The deep blue ocean below gently crashes against the rocks at the base of the cliff, creating swirls of white foam. Some of the rocks are partially submerged in water, while others jut out, weathered by the waves. On the right, the ocean extends toward the horizon, with the sunlight reflecting off the water, creating bright glimmers. The sky above is clear, with soft sunlight bathing the scene. The atmosphere is peaceful, with soft shadows cast on the rocks and water. The base of the cliff is composed of dark, rugged rocks with patches of algae that catch the light, while gentle waves leave traces of foam as they break against the rocks. . The visual style in these images can be characterized as highly exaggerated and cartoonish, with a playful use of perspective and distortion. The style features bold and vibrant color schemes, where each area of the scene uses a limited but intense palette, allowing the shapes and forms to stand out sharply. These colors are often applied in large, flat planes, giving the visuals a somewhat graphic novel-like quality, even though they are rendered with a painterly texture. The perspective is notably warped, creating an almost fisheye lens effect in some cases. This warping is especially evident in how walls and floors curve unnaturally, as if the viewer is seeing the scene through a distorted lens. This creates a surreal and exaggerated space that enhances the whimsical and absurd nature of the scenes. Shapes are angular, with a mix of sharp and flowing lines. There’s a clear emphasis on abstraction, where objects and architectural elements are simplified to their most recognizable forms but are bent and twisted to fit the playful tone of the scene. The use of negative space is also significant, where shadows and silhouettes create dynamic contrasts, further adding to the overall exaggerated aesthetic. The perspective does not follow strict rules of realism. Instead, it is dynamically altered to guide the viewer’s eye across the scene, often leading to a sense of depth through exaggerated angles. The lens-like distortion pulls the edges of the scene outward, creating a sense of expansion, as if the environment is stretching away from the viewer. This helps to create a visually engaging and immersive experience, despite the flatness of the color application. Overall, the style combines vibrant, exaggerated color with distorted shapes and a playful approach to perspective, resulting in a visually unique and whimsical world that feels both surreal and immersive. The style is a collage that emphasizes texture and a handmade feel. Use simple geometric shapes cut from textured paper, incorporating a mix of rough, uneven edges to mimic the look of hand-torn paper. Incorporate crayon or pastel-like effects on some of the elements, adding a slightly uneven, grainy texture. The colors should be soft and muted, with subtle variations in hue, as if lightly shaded or colored by hand. The background should have a textured, almost sponge-like appearance, with visible brush strokes or speckled effects. Overall, the piece should have a playful, handcrafted look, combining the rough, tactile qualities of traditional collage with the expressive, childlike feel of crayon or pastel artwork.
Prompt
RTMI cartoon character design. The image shows two singers passionately performing on stage, both holding microphones and singing with great emotion. The man on the left is bald, with a neatly trimmed beard and wearing a dark blue suit jacket over a white shirt. His head is tilted slightly upward as he sings, with his mouth wide open, conveying intensity and energy. His right hand grips the microphone tightly, and his left hand is extended outwards, as if emphasizing the power of his performance. To his right is a woman with long, curly blonde hair cascading over her shoulders. She is wearing a black, sparkling dress with a deep neckline, and she too is singing with enthusiasm. Her expression is powerful, with her mouth open wide as she belts out a note. She holds her microphone in her right hand, while her left hand is extended in a dramatic gesture, as if reaching out to the audience. She wears a watch on her left wrist and a ring on her right hand, adding to her glamorous appearance. The background features a stage with a decorative backdrop that includes a large circular design in shades of yellow and orange, resembling an abstract sun. Overhead, green stage lights illuminate the scene, casting a vibrant glow on the performers. Behind them, a dark curtain provides contrast, making the singers stand out even more. The atmosphere is lively, with the lighting and their dynamic expressions capturing the essence of a passionate performance.
Prompt
RTMI style. illustration of spiderman at the comic con
Prompt
RTMI style. character design. The image depicts Monna Lisa by leonardo da vinci in cartoon RTMI style.
Prompt
RTMI cartoon style character design. This image captures a casual indoor scene, likely taken in a clothing store or a wardrobe area filled with various garments. The focal point is a caucasian man standing in the center, smiling broadly with a friendly, relaxed expression. The overall style evokes a playful, almost retro vibe. The man is wearing a tight-fitting, long-sleeved gray shirt, which closely follows the contours of his body. The man has sweaty armpits in darker color. Around his neck, he is wearing a tan and beige checkered scarf, loosely wrapped but still snug enough to stand out as a fashion accessory. The scarf's texture appears soft, perhaps woolen or knit, and it adds an element of warmth and contrast to his otherwise sleek outfit. In the background, the space is organized with shelving and clothing displays. On the left, a shelving unit holds a few folded garments, including shirts or sweaters, neatly stacked in different colors. Next to him on the countertop is a black shopping bag adorned with white and green designs and text, possibly from the store itself. A vibrant green ribbon is attached to the bag, adding a pop of color. Behind him, part of the shelving has decorative items, including what looks like a small piece of art or signage featuring bold black and white graphics. To the right of the man, a bright green curtain is partially visible, which may be a fitting room or divider within the space. The lighting in the room is moderate, with a soft glow illuminating the scene evenly, giving it a clear, well-lit appearance without harsh shadows. The atmosphere feels casual and perhaps a bit playful, given the man's fashionable and somewhat whimsical look. the man's hairstyle is a striking feature, characterized by a mix of textures that gives it a carefully styled yet relaxed appearance. His hair is dark, likely black or very dark brown, with a healthy, shiny finish. The style is divided into two distinct textures: a sleek, straight fringe (bangs) at the front, and voluminous, professionally styled curls throughout the rest of the hair. The fringe is straight and falls neatly over his forehead, with several strands parted slightly in the middle. The bangs are relatively long, reaching just above his eyebrows. The hair is smooth and flat against his forehead, providing a sharp contrast to the more voluminous curls behind it. The straightness of the fringe is likely intentional, adding a polished, elegant touch to his look. The rest of his hair, in contrast, is full of soft, bouncy curls, similar to those created with a curling iron or from a salon blowout. These curls start at the sides of his head and flow outward, adding significant volume and a lively texture. The curls are medium in size, not too tight but defined enough to create a dynamic, flowing look. The back of his hair maintains this voluminous curl pattern, rounding out the shape of his hairstyle and giving it a balanced, full appearance. This blend of sleek, straight bangs with voluminous curls creates a unique juxtaposition, adding both sophistication and a touch of playfulness to his overall style. The hairstyle feels modern but with a nod to vintage influences, combining the precision of straight bangs with the soft glamour of big, flowing curls. It’s clear that this look has been styled with care, likely in a salon setting, to achieve this distinct mix of textures. The curls go down the shoulders

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers