datnt114 commited on
Commit
4ec5ad2
1 Parent(s): 7054cf6

Model card auto-generated by SimpleTuner

Browse files
Files changed (1) hide show
  1. README.md +203 -0
README.md ADDED
@@ -0,0 +1,203 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: "black-forest-labs/FLUX.1-dev"
4
+ tags:
5
+ - flux
6
+ - flux-diffusers
7
+ - text-to-image
8
+ - diffusers
9
+ - simpletuner
10
+ - safe-for-work
11
+ - lora
12
+ - template:sd-lora
13
+ - lycoris
14
+ inference: true
15
+ widget:
16
+ - text: 'unconditional (blank prompt)'
17
+ parameters:
18
+ negative_prompt: 'blurry, cropped, ugly'
19
+ output:
20
+ url: ./assets/image_0_0.png
21
+ - text: 'In this enchanting scene, a colossal full moon, glowing with an ethereal light and drenched in golden hues, dominates the sky in the background, casting reflections on a serene lake below. The moon''s surface is intricately detailed with deep craters and luminous spots, creating a surreal, fantastical element. Silhouetted in the foreground, a stately tree with dense foliage stands beside a tranquil shoreline, its branches and leaves intricately outlined against the twilight sky. Further along the horizon, darkened shadows of distant trees create a mysterious and calming expanse, hinting at the wilderness beyond. The sky is dotted with twinkling stars, enhancing the magical ambience of the night. Thick, mystical clouds ripple through the scene, adding depth and dynamism to the atmosphere. The serene water of the lake mirrors the brilliant glow of the moon, creating rippling patterns that shimmer and dance in the night. The overall mood is a blend of tranquility and enchantment, with uniform clarity and vivid colors throughout. The intense otherworldly light from the moon and the detailed textures in the foreground and background together produce a scene filled with harmonious clarity and surreal beauty, making every element stand out in the magical landscape.'
22
+ parameters:
23
+ negative_prompt: 'blurry, cropped, ugly'
24
+ output:
25
+ url: ./assets/image_1_0.png
26
+ - text: 'This idyllic alpine scene captures a serene lake nestled between lush green hills and towering mountains capped with snow. A wooden chalet, located on a gently sloping hill, overlooks the vibrant turquoise waters of the lake, its spacious balcony offering sweeping views of the breathtaking landscape. The surrounding meadows are dotted with colorful wildflowers, and tall trees line the hillsides, blending harmoniously with the forested mountains in the distance. Beyond the lake, a small village can be seen, framed by majestic peaks that rise sharply against a bright blue sky adorned with fluffy white clouds. The crystal-clear water reflects the sky and the surrounding greenery, enhancing the tranquility of the scene. Every detail, from the texture of the grass to the snow on the distant mountains, is rendered with vibrant clarity, evoking a sense of peace and natural beauty in this picturesque mountain retreat.'
27
+ parameters:
28
+ negative_prompt: 'blurry, cropped, ugly'
29
+ output:
30
+ url: ./assets/image_2_0.png
31
+ - text: 'This picturesque landscape captures a breathtaking view of an alpine valley where a tranquil lake nestles among lush green hills. Snow-capped mountain peaks tower in the background, creating a dramatic contrast with the vivid greenery and deep blue waters. A winding path, flanked by wildflowers and fresh grass, leads the eye through the scene, inviting exploration into this pristine environment. The foreground is dotted with yellow and purple wildflowers, adding splashes of color that enhance the natural beauty of the area. Patches of trees scattered across the hillsides and along the lake''s edge provide depth and texture to the landscape. Above, fluffy white clouds float in a clear blue sky, casting soft shadows on the mountains and reflecting the serene atmosphere of this peaceful retreat. The entire scene is bathed in bright, natural light, highlighting the rich details and vibrant colors of this idyllic mountain setting.'
32
+ parameters:
33
+ negative_prompt: 'blurry, cropped, ugly'
34
+ output:
35
+ url: ./assets/image_3_0.png
36
+ - text: 'A serene, dreamlike landscape unfolds beneath a massive full moon that hangs low in the sky, casting its silver glow over a tranquil lake. The moon''s soft light reflects on the still water, surrounded by lush, evergreen trees that form a dense forest on either side of the lake. In the distance, the silhouettes of rolling mountains are bathed in the vibrant hues of a twilight sky, blending pink, purple, and orange as stars begin to twinkle. The foreground is dotted with wildflowers in shades of pink and white, their delicate petals illuminated by the moonlight. The atmosphere is calm and otherworldly, with the sky''s gradient colors and the gentle light creating a peaceful, magical ambiance. Every detail, from the intricate textures of the flowers to the rippling reflections in the water, is vividly highlighted by the moon''s ethereal glow, evoking a sense of tranquility and wonder.'
37
+ parameters:
38
+ negative_prompt: 'blurry, cropped, ugly'
39
+ output:
40
+ url: ./assets/image_4_0.png
41
+ - text: 'In this enchanting nighttime scene, a serene landscape unfolds under the luminous glow of a full moon, casting a mystical light over the entire setting. Graceful lotuses, adorned with delicate pink and white petals, bloom amidst vibrant green lily pads that float effortlessly on a tranquil lake. The flowers, some in full bloom and others budding, create a harmonious, natural arrangement predominantly in the foreground, extending gracefully towards the right and left edges of the scene. The background reveals a vast, still body of water reflecting the shimmering moonlight, bordered by silhouettes of distant trees and undulating hills shrouded in the subtle haze of the night. Above, a crisp, star-studded sky completes the ethereal atmosphere, with twinkling stars scattered across the deep blue canvas, enhancing the surreal and dreamlike mood of the scene. The entire image is enveloped in vivid colors, consistent magical light, and intricate details that ensure every element, from the reflective water to the delicate petal veins, is equally prominent and clear, creating a vivid, otherworldly ambiance. The lighting accentuates the textures and ethereal tones, producing a surreal atmosphere where the scene appears uniformly crisp and intensely luminous, achieving a harmonious balance of clarity and mystique.'
42
+ parameters:
43
+ negative_prompt: 'blurry, cropped, ugly'
44
+ output:
45
+ url: ./assets/image_5_0.png
46
+ - text: 'In an enchanted forest illuminated by a golden light, a cascading series of crystal-clear waterfalls shimmer with an ethereal blue hue as they flow gently down a rocky terrain, meandering through the lush green vegetation and moss-covered stones. The forest floor is alive with bioluminescent plants and flowers glowing in soft shades of purple and blue, creating a magical path that leads deeper into the mystical woods. Ancient trees with enormous, sprawling roots stand majestically, their branches entwined in a canopy that filters the light, casting intricate patterns on the ground. Tiny, luminous fireflies float whimsically throughout the scene, adding to the dreamlike quality. There are also a few rustic lanterns placed along the edge of the stream, their warm light blending seamlessly with the natural glow of the forest. The overall atmosphere is serene and mysterious, evoking feelings of wonder and enchantment in this fantastical world. The scene is portrayed with rich detail and consistent magical light, highlighting the intricate textures of the foliage, the surreal tones of the water, and the delicate luminescence of the fireflies to create a harmonious clarity throughout the image, with vivid colors and an intense, otherworldly light, punctuating the enchanted mood.'
47
+ parameters:
48
+ negative_prompt: 'blurry, cropped, ugly'
49
+ output:
50
+ url: ./assets/image_6_0.png
51
+ - text: 'In the center of a calm, mystical lake, a perfectly balanced stack of smooth, rounded stones rises prominently, symbolizing tranquility and balance. This curiously sculpted cairn, composed of stones of varying sizes from large at the base to small at the top, seems to float just above the water, as if defying gravity. The serene waters mirror the arrangement, creating a symmetrical reflection that amplifies its surreal presence. Surrounding the lake, a tranquil forest gently embraces the scene with tall, silhouetted trees that merge into the misty horizon. The setting sun bathes the sky in hues of warm amber, soft pink, and gentle orange, casting an ethereal glow across the entire landscape. The atmosphere is peaceful and meditative, accentuating the magical tranquility that envelops this fantasy world. This ethereal scene is infused with rich detail and color, from the luminous sunset to the subtly reflective water, ensuring that every stone, every ripple, and the distant outlines of trees stand out with vivid clarity. The lighting captures every aspect with a harmonious clarity, bringing out detailed textures and creating a high contrast yet serene atmosphere, filling the scene with an intense, otherworldly light that enhances its magical and surreal qualities.'
52
+ parameters:
53
+ negative_prompt: 'blurry, cropped, ugly'
54
+ output:
55
+ url: ./assets/image_7_0.png
56
+ - text: 'In an enchanting, mythical glade, a statue of Buddha sits serenely at the center of the frame, exuding an aura of tranquility and spiritual calm. The Buddha statue, carved from stone and adorned with intricate details, is positioned on a lush green lotus pedestal that floats amidst a serene pond. Vibrant pink and white lotus flowers bloom around the statue, adding a touch of natural beauty to this sacred scene. Surrounding the Buddha, a cascade of ethereal waterfalls glistens in the ambient mystical light, flowing gently from rocky heights covered in vivid green moss and vegetation. The background reveals a secluded, magical forest bathed in soft, soothing light, with towering trees and delicate shafts of sunlight piercing through the foliage, highlighting the surreal beauty of the landscape. The entire scene is adorned with vivid colors, consistent magical light, and detailed textures that make the ethereal tones and intricate background come alive. The harmonious clarity, high contrast, and intense otherworldly light ensure every element is vividly portrayed, creating a scene where nothing is obscured and the serene, surreal atmosphere is palpable.'
57
+ parameters:
58
+ negative_prompt: 'blurry, cropped, ugly'
59
+ output:
60
+ url: ./assets/image_8_0.png
61
+ - text: 'An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.'
62
+ parameters:
63
+ negative_prompt: 'blurry, cropped, ugly'
64
+ output:
65
+ url: ./assets/image_9_0.png
66
+ ---
67
+
68
+ # flux-natural-12-09-int8
69
+
70
+ This is a LyCORIS adapter derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
71
+
72
+
73
+ The main validation prompt used during training was:
74
+
75
+
76
+
77
+ ```
78
+ An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.
79
+ ```
80
+
81
+ ## Validation settings
82
+ - CFG: `4.0`
83
+ - CFG Rescale: `0.0`
84
+ - Steps: `20`
85
+ - Sampler: `None`
86
+ - Seed: `42`
87
+ - Resolution: `1344x768`
88
+
89
+ Note: The validation settings are not necessarily the same as the [training settings](#training-settings).
90
+
91
+ You can find some example images in the following gallery:
92
+
93
+
94
+ <Gallery />
95
+
96
+ The text encoder **was not** trained.
97
+ You may reuse the base model text encoder for inference.
98
+
99
+
100
+ ## Training settings
101
+
102
+ - Training epochs: 0
103
+ - Training steps: 500
104
+ - Learning rate: 0.0001
105
+ - Effective batch size: 1
106
+ - Micro-batch size: 1
107
+ - Gradient accumulation steps: 1
108
+ - Number of GPUs: 1
109
+ - Prediction type: flow-matching
110
+ - Rescaled betas zero SNR: False
111
+ - Optimizer: adamw_bf16
112
+ - Precision: Pure BF16
113
+ - Quantised: Yes: int8-quanto
114
+ - Xformers: Not used
115
+ - LyCORIS Config:
116
+ ```json
117
+ {
118
+ "algo": "lokr",
119
+ "multiplier": 1.0,
120
+ "linear_dim": 10000,
121
+ "linear_alpha": 1,
122
+ "factor": 16,
123
+ "apply_preset": {
124
+ "target_module": [
125
+ "Attention",
126
+ "FeedForward"
127
+ ],
128
+ "module_algo_map": {
129
+ "Attention": {
130
+ "factor": 16
131
+ },
132
+ "FeedForward": {
133
+ "factor": 8
134
+ }
135
+ }
136
+ }
137
+ }
138
+ ```
139
+
140
+ ## Datasets
141
+
142
+ ### data-12-09-512
143
+ - Repeats: 10
144
+ - Total number of images: 271
145
+ - Total number of aspect buckets: 1
146
+ - Resolution: 0.262144 megapixels
147
+ - Cropped: False
148
+ - Crop style: None
149
+ - Crop aspect: None
150
+ ### data-12-09-1024
151
+ - Repeats: 10
152
+ - Total number of images: 269
153
+ - Total number of aspect buckets: 1
154
+ - Resolution: 1.048576 megapixels
155
+ - Cropped: False
156
+ - Crop style: None
157
+ - Crop aspect: None
158
+ ### data-12-09-512-crop
159
+ - Repeats: 10
160
+ - Total number of images: 271
161
+ - Total number of aspect buckets: 1
162
+ - Resolution: 0.262144 megapixels
163
+ - Cropped: True
164
+ - Crop style: random
165
+ - Crop aspect: square
166
+ ### data-12-09-1024-crop
167
+ - Repeats: 10
168
+ - Total number of images: 271
169
+ - Total number of aspect buckets: 1
170
+ - Resolution: 1.048576 megapixels
171
+ - Cropped: True
172
+ - Crop style: random
173
+ - Crop aspect: square
174
+
175
+
176
+ ## Inference
177
+
178
+
179
+ ```python
180
+ import torch
181
+ from diffusers import DiffusionPipeline
182
+ from lycoris import create_lycoris_from_weights
183
+
184
+ model_id = 'black-forest-labs/FLUX.1-dev'
185
+ adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
186
+ lora_scale = 1.0
187
+ wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
188
+ wrapper.merge_to()
189
+
190
+ prompt = "An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed."
191
+
192
+ pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
193
+ image = pipeline(
194
+ prompt=prompt,
195
+ num_inference_steps=20,
196
+ generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
197
+ width=1344,
198
+ height=768,
199
+ guidance_scale=4.0,
200
+ ).images[0]
201
+ image.save("output.png", format="PNG")
202
+ ```
203
+