metadata

license: other
base_model: black-forest-labs/FLUX.1-dev
tags:
  - flux
  - flux-diffusers
  - text-to-image
  - diffusers
  - simpletuner
  - safe-for-work
  - lora
  - template:sd-lora
  - lycoris
inference: true
widget:
  - text: unconditional (blank prompt)
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_0_0.png
  - text: >-
      In this enchanting scene, a colossal full moon, glowing with an ethereal
      light and drenched in golden hues, dominates the sky in the background,
      casting reflections on a serene lake below. The moon's surface is
      intricately detailed with deep craters and luminous spots, creating a
      surreal, fantastical element. Silhouetted in the foreground, a stately
      tree with dense foliage stands beside a tranquil shoreline, its branches
      and leaves intricately outlined against the twilight sky. Further along
      the horizon, darkened shadows of distant trees create a mysterious and
      calming expanse, hinting at the wilderness beyond. The sky is dotted with
      twinkling stars, enhancing the magical ambience of the night. Thick,
      mystical clouds ripple through the scene, adding depth and dynamism to the
      atmosphere. The serene water of the lake mirrors the brilliant glow of the
      moon, creating rippling patterns that shimmer and dance in the night. The
      overall mood is a blend of tranquility and enchantment, with uniform
      clarity and vivid colors throughout. The intense otherworldly light from
      the moon and the detailed textures in the foreground and background
      together produce a scene filled with harmonious clarity and surreal
      beauty, making every element stand out in the magical landscape.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_1_0.png
  - text: >-
      This idyllic alpine scene captures a serene lake nestled between lush
      green hills and towering mountains capped with snow. A wooden chalet,
      located on a gently sloping hill, overlooks the vibrant turquoise waters
      of the lake, its spacious balcony offering sweeping views of the
      breathtaking landscape. The surrounding meadows are dotted with colorful
      wildflowers, and tall trees line the hillsides, blending harmoniously with
      the forested mountains in the distance. Beyond the lake, a small village
      can be seen, framed by majestic peaks that rise sharply against a bright
      blue sky adorned with fluffy white clouds. The crystal-clear water
      reflects the sky and the surrounding greenery, enhancing the tranquility
      of the scene. Every detail, from the texture of the grass to the snow on
      the distant mountains, is rendered with vibrant clarity, evoking a sense
      of peace and natural beauty in this picturesque mountain retreat.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_2_0.png
  - text: >-
      This picturesque landscape captures a breathtaking view of an alpine
      valley where a tranquil lake nestles among lush green hills. Snow-capped
      mountain peaks tower in the background, creating a dramatic contrast with
      the vivid greenery and deep blue waters. A winding path, flanked by
      wildflowers and fresh grass, leads the eye through the scene, inviting
      exploration into this pristine environment. The foreground is dotted with
      yellow and purple wildflowers, adding splashes of color that enhance the
      natural beauty of the area. Patches of trees scattered across the
      hillsides and along the lake's edge provide depth and texture to the
      landscape. Above, fluffy white clouds float in a clear blue sky, casting
      soft shadows on the mountains and reflecting the serene atmosphere of this
      peaceful retreat. The entire scene is bathed in bright, natural light,
      highlighting the rich details and vibrant colors of this idyllic mountain
      setting.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_3_0.png
  - text: >-
      A serene, dreamlike landscape unfolds beneath a massive full moon that
      hangs low in the sky, casting its silver glow over a tranquil lake. The
      moon's soft light reflects on the still water, surrounded by lush,
      evergreen trees that form a dense forest on either side of the lake. In
      the distance, the silhouettes of rolling mountains are bathed in the
      vibrant hues of a twilight sky, blending pink, purple, and orange as stars
      begin to twinkle. The foreground is dotted with wildflowers in shades of
      pink and white, their delicate petals illuminated by the moonlight. The
      atmosphere is calm and otherworldly, with the sky's gradient colors and
      the gentle light creating a peaceful, magical ambiance. Every detail, from
      the intricate textures of the flowers to the rippling reflections in the
      water, is vividly highlighted by the moon's ethereal glow, evoking a sense
      of tranquility and wonder.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_4_0.png
  - text: >-
      In this enchanting nighttime scene, a serene landscape unfolds under the
      luminous glow of a full moon, casting a mystical light over the entire
      setting. Graceful lotuses, adorned with delicate pink and white petals,
      bloom amidst vibrant green lily pads that float effortlessly on a tranquil
      lake. The flowers, some in full bloom and others budding, create a
      harmonious, natural arrangement predominantly in the foreground, extending
      gracefully towards the right and left edges of the scene. The background
      reveals a vast, still body of water reflecting the shimmering moonlight,
      bordered by silhouettes of distant trees and undulating hills shrouded in
      the subtle haze of the night. Above, a crisp, star-studded sky completes
      the ethereal atmosphere, with twinkling stars scattered across the deep
      blue canvas, enhancing the surreal and dreamlike mood of the scene. The
      entire image is enveloped in vivid colors, consistent magical light, and
      intricate details that ensure every element, from the reflective water to
      the delicate petal veins, is equally prominent and clear, creating a
      vivid, otherworldly ambiance. The lighting accentuates the textures and
      ethereal tones, producing a surreal atmosphere where the scene appears
      uniformly crisp and intensely luminous, achieving a harmonious balance of
      clarity and mystique.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_5_0.png
  - text: >-
      In an enchanted forest illuminated by a golden light, a cascading series
      of crystal-clear waterfalls shimmer with an ethereal blue hue as they flow
      gently down a rocky terrain, meandering through the lush green vegetation
      and moss-covered stones. The forest floor is alive with bioluminescent
      plants and flowers glowing in soft shades of purple and blue, creating a
      magical path that leads deeper into the mystical woods. Ancient trees with
      enormous, sprawling roots stand majestically, their branches entwined in a
      canopy that filters the light, casting intricate patterns on the ground.
      Tiny, luminous fireflies float whimsically throughout the scene, adding to
      the dreamlike quality. There are also a few rustic lanterns placed along
      the edge of the stream, their warm light blending seamlessly with the
      natural glow of the forest. The overall atmosphere is serene and
      mysterious, evoking feelings of wonder and enchantment in this fantastical
      world. The scene is portrayed with rich detail and consistent magical
      light, highlighting the intricate textures of the foliage, the surreal
      tones of the water, and the delicate luminescence of the fireflies to
      create a harmonious clarity throughout the image, with vivid colors and an
      intense, otherworldly light, punctuating the enchanted mood.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_6_0.png
  - text: >-
      In the center of a calm, mystical lake, a perfectly balanced stack of
      smooth, rounded stones rises prominently, symbolizing tranquility and
      balance. This curiously sculpted cairn, composed of stones of varying
      sizes from large at the base to small at the top, seems to float just
      above the water, as if defying gravity. The serene waters mirror the
      arrangement, creating a symmetrical reflection that amplifies its surreal
      presence. Surrounding the lake, a tranquil forest gently embraces the
      scene with tall, silhouetted trees that merge into the misty horizon. The
      setting sun bathes the sky in hues of warm amber, soft pink, and gentle
      orange, casting an ethereal glow across the entire landscape. The
      atmosphere is peaceful and meditative, accentuating the magical
      tranquility that envelops this fantasy world. This ethereal scene is
      infused with rich detail and color, from the luminous sunset to the subtly
      reflective water, ensuring that every stone, every ripple, and the distant
      outlines of trees stand out with vivid clarity. The lighting captures
      every aspect with a harmonious clarity, bringing out detailed textures and
      creating a high contrast yet serene atmosphere, filling the scene with an
      intense, otherworldly light that enhances its magical and surreal
      qualities.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_7_0.png
  - text: >-
      In an enchanting, mythical glade, a statue of Buddha sits serenely at the
      center of the frame, exuding an aura of tranquility and spiritual calm.
      The Buddha statue, carved from stone and adorned with intricate details,
      is positioned on a lush green lotus pedestal that floats amidst a serene
      pond. Vibrant pink and white lotus flowers bloom around the statue, adding
      a touch of natural beauty to this sacred scene. Surrounding the Buddha, a
      cascade of ethereal waterfalls glistens in the ambient mystical light,
      flowing gently from rocky heights covered in vivid green moss and
      vegetation. The background reveals a secluded, magical forest bathed in
      soft, soothing light, with towering trees and delicate shafts of sunlight
      piercing through the foliage, highlighting the surreal beauty of the
      landscape. The entire scene is adorned with vivid colors, consistent
      magical light, and detailed textures that make the ethereal tones and
      intricate background come alive. The harmonious clarity, high contrast,
      and intense otherworldly light ensure every element is vividly portrayed,
      creating a scene where nothing is obscured and the serene, surreal
      atmosphere is palpable.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_8_0.png
  - text: >-
      An illustration of a serene landscape at night, moonlit mountain scene,
      tall pine trees on a small island, snow-capped mountains in the
      background, still lake reflecting trees and full moon, cloud-speckled sky
      dotted with stars, soft ambient lighting, primary color tones of blue and
      white, ambient and tranquil atmosphere, high resolution, extremely
      detailed.
    parameters:
      negative_prompt: blurry, cropped, ugly
    output:
      url: ./assets/image_9_0.png

flux-natural-12-09-int8

This is a LyCORIS adapter derived from black-forest-labs/FLUX.1-dev.

The main validation prompt used during training was:

An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.

Validation settings

CFG: 4.0
CFG Rescale: 0.0
Steps: 20
Sampler: None
Seed: 42
Resolution: 1344x768

Note: The validation settings are not necessarily the same as the training settings.

You can find some example images in the following gallery:

Prompt
unconditional (blank prompt)

Negative Prompt
blurry, cropped, ugly

Prompt
In this enchanting scene, a colossal full moon, glowing with an ethereal light and drenched in golden hues, dominates the sky in the background, casting reflections on a serene lake below. The moon's surface is intricately detailed with deep craters and luminous spots, creating a surreal, fantastical element. Silhouetted in the foreground, a stately tree with dense foliage stands beside a tranquil shoreline, its branches and leaves intricately outlined against the twilight sky. Further along the horizon, darkened shadows of distant trees create a mysterious and calming expanse, hinting at the wilderness beyond. The sky is dotted with twinkling stars, enhancing the magical ambience of the night. Thick, mystical clouds ripple through the scene, adding depth and dynamism to the atmosphere. The serene water of the lake mirrors the brilliant glow of the moon, creating rippling patterns that shimmer and dance in the night. The overall mood is a blend of tranquility and enchantment, with uniform clarity and vivid colors throughout. The intense otherworldly light from the moon and the detailed textures in the foreground and background together produce a scene filled with harmonious clarity and surreal beauty, making every element stand out in the magical landscape.

Negative Prompt
blurry, cropped, ugly

Prompt
This idyllic alpine scene captures a serene lake nestled between lush green hills and towering mountains capped with snow. A wooden chalet, located on a gently sloping hill, overlooks the vibrant turquoise waters of the lake, its spacious balcony offering sweeping views of the breathtaking landscape. The surrounding meadows are dotted with colorful wildflowers, and tall trees line the hillsides, blending harmoniously with the forested mountains in the distance. Beyond the lake, a small village can be seen, framed by majestic peaks that rise sharply against a bright blue sky adorned with fluffy white clouds. The crystal-clear water reflects the sky and the surrounding greenery, enhancing the tranquility of the scene. Every detail, from the texture of the grass to the snow on the distant mountains, is rendered with vibrant clarity, evoking a sense of peace and natural beauty in this picturesque mountain retreat.

Negative Prompt
blurry, cropped, ugly

Prompt
This picturesque landscape captures a breathtaking view of an alpine valley where a tranquil lake nestles among lush green hills. Snow-capped mountain peaks tower in the background, creating a dramatic contrast with the vivid greenery and deep blue waters. A winding path, flanked by wildflowers and fresh grass, leads the eye through the scene, inviting exploration into this pristine environment. The foreground is dotted with yellow and purple wildflowers, adding splashes of color that enhance the natural beauty of the area. Patches of trees scattered across the hillsides and along the lake's edge provide depth and texture to the landscape. Above, fluffy white clouds float in a clear blue sky, casting soft shadows on the mountains and reflecting the serene atmosphere of this peaceful retreat. The entire scene is bathed in bright, natural light, highlighting the rich details and vibrant colors of this idyllic mountain setting.

Negative Prompt
blurry, cropped, ugly

Prompt
A serene, dreamlike landscape unfolds beneath a massive full moon that hangs low in the sky, casting its silver glow over a tranquil lake. The moon's soft light reflects on the still water, surrounded by lush, evergreen trees that form a dense forest on either side of the lake. In the distance, the silhouettes of rolling mountains are bathed in the vibrant hues of a twilight sky, blending pink, purple, and orange as stars begin to twinkle. The foreground is dotted with wildflowers in shades of pink and white, their delicate petals illuminated by the moonlight. The atmosphere is calm and otherworldly, with the sky's gradient colors and the gentle light creating a peaceful, magical ambiance. Every detail, from the intricate textures of the flowers to the rippling reflections in the water, is vividly highlighted by the moon's ethereal glow, evoking a sense of tranquility and wonder.

Negative Prompt
blurry, cropped, ugly

Prompt
In this enchanting nighttime scene, a serene landscape unfolds under the luminous glow of a full moon, casting a mystical light over the entire setting. Graceful lotuses, adorned with delicate pink and white petals, bloom amidst vibrant green lily pads that float effortlessly on a tranquil lake. The flowers, some in full bloom and others budding, create a harmonious, natural arrangement predominantly in the foreground, extending gracefully towards the right and left edges of the scene. The background reveals a vast, still body of water reflecting the shimmering moonlight, bordered by silhouettes of distant trees and undulating hills shrouded in the subtle haze of the night. Above, a crisp, star-studded sky completes the ethereal atmosphere, with twinkling stars scattered across the deep blue canvas, enhancing the surreal and dreamlike mood of the scene. The entire image is enveloped in vivid colors, consistent magical light, and intricate details that ensure every element, from the reflective water to the delicate petal veins, is equally prominent and clear, creating a vivid, otherworldly ambiance. The lighting accentuates the textures and ethereal tones, producing a surreal atmosphere where the scene appears uniformly crisp and intensely luminous, achieving a harmonious balance of clarity and mystique.

Negative Prompt
blurry, cropped, ugly

Prompt
In an enchanted forest illuminated by a golden light, a cascading series of crystal-clear waterfalls shimmer with an ethereal blue hue as they flow gently down a rocky terrain, meandering through the lush green vegetation and moss-covered stones. The forest floor is alive with bioluminescent plants and flowers glowing in soft shades of purple and blue, creating a magical path that leads deeper into the mystical woods. Ancient trees with enormous, sprawling roots stand majestically, their branches entwined in a canopy that filters the light, casting intricate patterns on the ground. Tiny, luminous fireflies float whimsically throughout the scene, adding to the dreamlike quality. There are also a few rustic lanterns placed along the edge of the stream, their warm light blending seamlessly with the natural glow of the forest. The overall atmosphere is serene and mysterious, evoking feelings of wonder and enchantment in this fantastical world. The scene is portrayed with rich detail and consistent magical light, highlighting the intricate textures of the foliage, the surreal tones of the water, and the delicate luminescence of the fireflies to create a harmonious clarity throughout the image, with vivid colors and an intense, otherworldly light, punctuating the enchanted mood.

Negative Prompt
blurry, cropped, ugly

Prompt
In the center of a calm, mystical lake, a perfectly balanced stack of smooth, rounded stones rises prominently, symbolizing tranquility and balance. This curiously sculpted cairn, composed of stones of varying sizes from large at the base to small at the top, seems to float just above the water, as if defying gravity. The serene waters mirror the arrangement, creating a symmetrical reflection that amplifies its surreal presence. Surrounding the lake, a tranquil forest gently embraces the scene with tall, silhouetted trees that merge into the misty horizon. The setting sun bathes the sky in hues of warm amber, soft pink, and gentle orange, casting an ethereal glow across the entire landscape. The atmosphere is peaceful and meditative, accentuating the magical tranquility that envelops this fantasy world. This ethereal scene is infused with rich detail and color, from the luminous sunset to the subtly reflective water, ensuring that every stone, every ripple, and the distant outlines of trees stand out with vivid clarity. The lighting captures every aspect with a harmonious clarity, bringing out detailed textures and creating a high contrast yet serene atmosphere, filling the scene with an intense, otherworldly light that enhances its magical and surreal qualities.

Negative Prompt
blurry, cropped, ugly

Prompt
In an enchanting, mythical glade, a statue of Buddha sits serenely at the center of the frame, exuding an aura of tranquility and spiritual calm. The Buddha statue, carved from stone and adorned with intricate details, is positioned on a lush green lotus pedestal that floats amidst a serene pond. Vibrant pink and white lotus flowers bloom around the statue, adding a touch of natural beauty to this sacred scene. Surrounding the Buddha, a cascade of ethereal waterfalls glistens in the ambient mystical light, flowing gently from rocky heights covered in vivid green moss and vegetation. The background reveals a secluded, magical forest bathed in soft, soothing light, with towering trees and delicate shafts of sunlight piercing through the foliage, highlighting the surreal beauty of the landscape. The entire scene is adorned with vivid colors, consistent magical light, and detailed textures that make the ethereal tones and intricate background come alive. The harmonious clarity, high contrast, and intense otherworldly light ensure every element is vividly portrayed, creating a scene where nothing is obscured and the serene, surreal atmosphere is palpable.

Negative Prompt
blurry, cropped, ugly

Prompt
An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.

Negative Prompt
blurry, cropped, ugly

The text encoder was not trained. You may reuse the base model text encoder for inference.

Training settings

Training epochs: 0
Training steps: 10000
Learning rate: 0.0001
Effective batch size: 1
- Micro-batch size: 1
- Gradient accumulation steps: 1
- Number of GPUs: 1
Prediction type: flow-matching
Rescaled betas zero SNR: False
Optimizer: adamw_bf16
Precision: Pure BF16
Quantised: Yes: int8-quanto
Xformers: Not used
LyCORIS Config:

{
    "algo": "lokr",
    "multiplier": 1.0,
    "linear_dim": 10000,
    "linear_alpha": 1,
    "factor": 16,
    "apply_preset": {
        "target_module": [
            "Attention",
            "FeedForward"
        ],
        "module_algo_map": {
            "Attention": {
                "factor": 16
            },
            "FeedForward": {
                "factor": 8
            }
        }
    }
}

Datasets

data-12-09-512

Repeats: 10
Total number of images: 271
Total number of aspect buckets: 1
Resolution: 0.262144 megapixels
Cropped: False
Crop style: None
Crop aspect: None

data-12-09-1024

Repeats: 10
Total number of images: 269
Total number of aspect buckets: 1
Resolution: 1.048576 megapixels
Cropped: False
Crop style: None
Crop aspect: None

data-12-09-512-crop

Repeats: 10
Total number of images: 271
Total number of aspect buckets: 1
Resolution: 0.262144 megapixels
Cropped: True
Crop style: random
Crop aspect: square

data-12-09-1024-crop

Repeats: 10
Total number of images: 271
Total number of aspect buckets: 1
Resolution: 1.048576 megapixels
Cropped: True
Crop style: random
Crop aspect: square

Inference

import torch
from diffusers import DiffusionPipeline
from lycoris import create_lycoris_from_weights

model_id = 'black-forest-labs/FLUX.1-dev'
adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
lora_scale = 1.0
wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
wrapper.merge_to()

prompt = "An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed."

pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
image = pipeline(
    prompt=prompt,
    num_inference_steps=20,
    generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
    width=1344,
    height=768,
    guidance_scale=4.0,
).images[0]
image.save("output.png", format="PNG")