davidrd123 commited on
Commit
8cd40a1
1 Parent(s): daee9c5

Model card auto-generated by SimpleTuner

Browse files
Files changed (1) hide show
  1. README.md +200 -0
README.md ADDED
@@ -0,0 +1,200 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: "black-forest-labs/FLUX.1-dev"
4
+ tags:
5
+ - flux
6
+ - flux-diffusers
7
+ - text-to-image
8
+ - diffusers
9
+ - simpletuner
10
+ - safe-for-work
11
+ - lora
12
+ - template:sd-lora
13
+ - lycoris
14
+ inference: true
15
+ widget:
16
+ - text: 'unconditional (blank prompt)'
17
+ parameters:
18
+ negative_prompt: 'blurry, cropped, ugly'
19
+ output:
20
+ url: ./assets/image_0_0.png
21
+ - text: 'A hamster wearing a tiny spacesuit in the style of a m00nl4nd1ng photograph'
22
+ parameters:
23
+ negative_prompt: 'blurry, cropped, ugly'
24
+ output:
25
+ url: ./assets/image_1_0.png
26
+ - text: 'A steampunk-inspired hot air balloon floating over an alien landscape in the style of a m00nl4nd1ng photograph'
27
+ parameters:
28
+ negative_prompt: 'blurry, cropped, ugly'
29
+ output:
30
+ url: ./assets/image_2_0.png
31
+ - text: 'A Victorian-era robot having a tea party with stuffed animals in the style of a m00nl4nd1ng photograph'
32
+ parameters:
33
+ negative_prompt: 'blurry, cropped, ugly'
34
+ output:
35
+ url: ./assets/image_3_0.png
36
+ - text: 'An astronaut skateboarding on the rings of Saturn in the style of a m00nl4nd1ng photograph'
37
+ parameters:
38
+ negative_prompt: 'blurry, cropped, ugly'
39
+ output:
40
+ url: ./assets/image_4_0.png
41
+ - text: 'A jazz band of mythical creatures performing on a floating cloud stage in the style of a m00nl4nd1ng photograph'
42
+ parameters:
43
+ negative_prompt: 'blurry, cropped, ugly'
44
+ output:
45
+ url: ./assets/image_5_0.png
46
+ - text: 'A DeLorean car with unusual attachments materializing in a medieval village in the style of a m00nl4nd1ng photograph'
47
+ parameters:
48
+ negative_prompt: 'blurry, cropped, ugly'
49
+ output:
50
+ url: ./assets/image_6_0.png
51
+ - text: 'A futuristic city inside a giant glass dome with submarines as public transportation in the style of a m00nl4nd1ng photograph'
52
+ parameters:
53
+ negative_prompt: 'blurry, cropped, ugly'
54
+ output:
55
+ url: ./assets/image_7_0.png
56
+ - text: 'A complex Rube Goldberg machine making breakfast in a Victorian kitchen in the style of a m00nl4nd1ng photograph'
57
+ parameters:
58
+ negative_prompt: 'blurry, cropped, ugly'
59
+ output:
60
+ url: ./assets/image_8_0.png
61
+ - text: 'A group of friendly aliens having a picnic, with Earth visible in the background in the style of a m00nl4nd1ng photograph'
62
+ parameters:
63
+ negative_prompt: 'blurry, cropped, ugly'
64
+ output:
65
+ url: ./assets/image_9_0.png
66
+ - text: 'A mechanical forest powered by a gigantic clockwork heart in the style of a m00nl4nd1ng photograph'
67
+ parameters:
68
+ negative_prompt: 'blurry, cropped, ugly'
69
+ output:
70
+ url: ./assets/image_10_0.png
71
+ ---
72
+
73
+ # Moonlanding-Flux-ST-LoKr-36img-fal-331-full-warmup-bs8
74
+
75
+ This is a LyCORIS adapter derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
76
+
77
+
78
+ No validation prompt was used during training.
79
+
80
+
81
+
82
+
83
+ None
84
+
85
+
86
+ ## Validation settings
87
+ - CFG: `3.0`
88
+ - CFG Rescale: `0.0`
89
+ - Steps: `20`
90
+ - Sampler: `None`
91
+ - Seed: `42`
92
+ - Resolution: `1024x1024`
93
+
94
+ Note: The validation settings are not necessarily the same as the [training settings](#training-settings).
95
+
96
+ You can find some example images in the following gallery:
97
+
98
+
99
+ <Gallery />
100
+
101
+ The text encoder **was not** trained.
102
+ You may reuse the base model text encoder for inference.
103
+
104
+
105
+ ## Training settings
106
+
107
+ - Training epochs: 5
108
+ - Training steps: 200
109
+ - Learning rate: 0.001
110
+ - Effective batch size: 8
111
+ - Micro-batch size: 8
112
+ - Gradient accumulation steps: 1
113
+ - Number of GPUs: 1
114
+ - Prediction type: flow-matching
115
+ - Rescaled betas zero SNR: False
116
+ - Optimizer: adamw_bf16
117
+ - Precision: Pure BF16
118
+ - Quantised: Yes: int8-quanto
119
+ - Xformers: Not used
120
+ - LyCORIS Config:
121
+ ```json
122
+ {
123
+ "algo": "lokr",
124
+ "multiplier": 1.0,
125
+ "linear_dim": 10000,
126
+ "linear_alpha": 1,
127
+ "factor": 16,
128
+ "apply_preset": {
129
+ "target_module": [
130
+ "Attention",
131
+ "FeedForward"
132
+ ],
133
+ "module_algo_map": {
134
+ "Attention": {
135
+ "factor": 16
136
+ },
137
+ "FeedForward": {
138
+ "factor": 8
139
+ }
140
+ }
141
+ }
142
+ }
143
+ ```
144
+
145
+ ## Datasets
146
+
147
+ ### moonlanding-36img-512
148
+ - Repeats: 2
149
+ - Total number of images: 36
150
+ - Total number of aspect buckets: 1
151
+ - Resolution: 0.262144 megapixels
152
+ - Cropped: False
153
+ - Crop style: None
154
+ - Crop aspect: None
155
+ ### moonlanding-36img-768
156
+ - Repeats: 2
157
+ - Total number of images: 36
158
+ - Total number of aspect buckets: 1
159
+ - Resolution: 0.589824 megapixels
160
+ - Cropped: False
161
+ - Crop style: None
162
+ - Crop aspect: None
163
+ ### moonlanding-36img-1024
164
+ - Repeats: 0
165
+ - Total number of images: 36
166
+ - Total number of aspect buckets: 1
167
+ - Resolution: 1.048576 megapixels
168
+ - Cropped: False
169
+ - Crop style: None
170
+ - Crop aspect: None
171
+
172
+
173
+ ## Inference
174
+
175
+
176
+ ```python
177
+ import torch
178
+ from diffusers import DiffusionPipeline
179
+ from lycoris import create_lycoris_from_weights
180
+
181
+ model_id = 'black-forest-labs/FLUX.1-dev'
182
+ adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
183
+ lora_scale = 1.0
184
+ wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
185
+ wrapper.merge_to()
186
+
187
+ prompt = "An astronaut is riding a horse through the jungles of Thailand."
188
+
189
+ pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
190
+ image = pipeline(
191
+ prompt=prompt,
192
+ num_inference_steps=20,
193
+ generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
194
+ width=1024,
195
+ height=1024,
196
+ guidance_scale=3.0,
197
+ ).images[0]
198
+ image.save("output.png", format="PNG")
199
+ ```
200
+