updating with v1 details

README.md

@@ -3,27 +3,77 @@ license: other
 license_name: flux-1-dev-non-commercial-license
 license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
 language:
-- en
+  - en
 tags:
-- flux
-- diffusers
-- lora
-- replicate
+  - flux
+  - diffusers
+  - lora
+  - replicate
 base_model: "black-forest-labs/FLUX.1-dev"
 pipeline_tag: text-to-image
-instance_prompt: latentpop style
+widget:
+  - text: 'screenprint tshirt design, a happy cat holding a sign that says "I LOVE REPLICATE", LNTP illustration style'
+    output:
+      url: "images/1.webp"
+
+  - text: "a t-shirt, LNTP illustration style"
+    output:
+      url: "images/2.webp"
+
+  - text: "a young girl playing piano, yellow background, LNTP illustration style"
+    output:
+      url: "images/3.webp"
+
+  - text: "a book with the words 'Don't Panic!' written on cover, an homage to the hitchhikers guide to the galaxy, LNTP cartoon style"
+    output:
+      url: "images/4.jpg"
+
+  - text: "a robot, blue background, LNTP illustration style"
+    output:
+      url: "images/5.jpg"
+
+  - text: "girl, orange background, LNTP illustration style"
+    output:
+      url: "images/6.webp"
+
+instance_prompt: LNTP
 ---
 
-# Flux Latentpop
+# Flux latentpop
+
+flux-latentpop features vibrant backgrounds with grungy limited screenprinting color goodness.
 
-Trained on Replicate using:
+It does great with t-shirt designs, general illustrations, and character portraits.
 
-https://replicate.com/ostris/flux-dev-lora-trainer/train
+<Gallery />
+
+It was trained on Replicate, here: https://replicate.com/ostris/flux-dev-lora-trainer/train
+
+The training set is comprised of 23 images generated on MidJourney using the `--sref 3102110963` and `--personalize 3xdy3qw` flags. You can find the entire training set here: https://replicate.delivery/pbxt/Lg3C1KUPfrRZZvJFaaSTmQ9qtAyXSonLvLSuTuj4Nop9vcSu/2024-08-24-latentpop.zip
+
+Below are the training parameters I used, which seem to work fairly well for illustration/cartoony Flux LoRAs:
+
+```
+{
+  "steps": 1300,
+  "lora_rank": 24,
+  "optimizer": "adamw8bit",
+  "batch_size": 4,
+  "resolution": "512,768,1024",
+  "autocaption": true,
+  "input_images": "https://replicate.delivery/pbxt/Lg3C1KUPfrRZZvJFaaSTmQ9qtAyXSonLvLSuTuj4Nop9vcSu/2024-08-24-latentpop.zip",
+  "trigger_word": "LNTP",
+  "learning_rate": 0.0002,
+  "autocaption_suffix": "LNTP style",
+  "caption_dropout_rate": 0.05,
+}
+```
 
+Shoutout to @ciguleva on x who originally shared this sref on x: https://x.com/ciguleva/status/1827398343779098720
 
-## Trigger words
-You should use `latentpop style` to trigger the image generation.
+## Usage
 
+You should use `LNTP` to trigger the image generation. The output images look more stylistically interesting with a `guidance_scale` of ~`2.5`.
 
 ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
 

captions/1.txt

@@ -0,0 +1 @@
+A digital illustration of a person wearing a green hoodie and a mask with large horns on their head. The person is standing in front of an orange background. The illustration is in a comic book style.

captions/10.txt

@@ -0,0 +1 @@
+A painting of a green tractor with black wheels driving up a sandy hill, in a futuristic style with a sense of adventure, a sense of exploration, a sense of technology, a sense of the future, a science fiction movie scene rendered in the Unreal Engine.

captions/11.txt

@@ -0,0 +1 @@
+A painting of an astronaut in a white suit with a green helmet, sitting in a chair with a green umbilical cord attached to him. The astronaut is wearing a backpack and has a green hose connected to his suit. The scene is set against an orange background. The astronaut is looking upwards, possibly observing something in the distance. The painting is done in a vibrant and colorful style, with bold brush strokes and a sense of movement.

captions/12.txt

@@ -0,0 +1 @@
+A cartoon illustration of two alien characters, one with green skin and the other with white skin, standing next to each other and holding a gift. The characters are wearing black clothing and have a playful, whimsical appearance. The scene is drawn in a cartoon style.

captions/13.txt

@@ -0,0 +1 @@
+A cartoon illustration of a girl with black hair, wearing a yellow jumpsuit and black shorts, flying through the air. She has a surprised look on her face and is surrounded by three orange stars. The image is in a futuristic style, with a sense of adventure and excitement.

captions/14.txt

@@ -0,0 +1 @@
+A cartoon illustration of a young girl wearing a yellow jacket and headphones, sitting on the ground with her eyes closed. The illustration is in a comic book style, with bold colors and exaggerated features. The girl is wearing a yellow and black outfit, and the headphones are prominently displayed on her head. The scene is set against a bright yellow background, which adds to the vibrant and playful nature of the illustration. LNTP style.

captions/15.txt

@@ -0,0 +1 @@
+A painting of a young girl with black hair, wearing a yellow jumpsuit, and holding a red ball. She is sitting on the ground with her mouth open, and there are two more balls in the scene, one on the left side and one on the right. The style of the image is a comic book style.

captions/16.txt

@@ -0,0 +1 @@
+A cartoon illustration of a girl wearing an orange hat and orange shirt, holding an orange book. She is surrounded by green plants and a green lizard. The scene is drawn in a black and orange style.

captions/17.txt

@@ -0,0 +1 @@
+A painting of a young girl wearing a green hat and jacket, standing in front of two green dogs. The girl is wearing a backpack and has a surprised look on her face. The dogs are positioned to the left and right of the girl, with one dog closer to the left side and the other dog closer to the right side. The scene is set in a dark background, with the girl and dogs being the main focus of the image. The style of the image is a digital illustration, with a playful and whimsical tone.

captions/18.txt

@@ -0,0 +1 @@
+A cartoon illustration of a woman with a green headband, wearing a yellow shirt and black pants. She is looking angry and has a frowning expression. The image is drawn in a comic book style.

captions/19.txt

@@ -0,0 +1 @@
+A cartoon illustration of a girl with black hair, wearing an orange hoodie, sitting on the ground and looking up at a planet. The girl is wearing black boots and has a surprised look on her face. The scene is set against a yellow background, with stars scattered throughout the image. The illustration is in a black and white style, giving it a classic and timeless feel.

captions/2.txt

@@ -0,0 +1 @@
+A cartoon illustration of a person wearing a black hoodie, a yellow helmet, and a yellow mask. The person is standing in front of an orange background. The illustration has a futuristic style.

captions/20.txt

@@ -0,0 +1 @@
+A cartoon illustration of a woman wearing a green hat and apron, holding a bowl and a spoon. The woman has a frowning expression on her face. The image is drawn in a simple, cartoon style.

captions/21.txt

@@ -0,0 +1 @@
+A digital illustration of a young boy wearing a yellow spacesuit, with a red helmet and red boots. He is floating in the air, looking up at a planet. The boy is wearing a patch on his suit, and the scene is set against a black background with stars. The illustration has a playful and whimsical style.

captions/22.txt

@@ -0,0 +1 @@
+A cartoon illustration, drawn in a comic book style, features a young boy wearing a spacesuit and helmet, sitting in a space shuttle. The boy has his mouth open, possibly in surprise or excitement. The space shuttle is the main focus of the image, with the boy sitting inside it, and the illustration is rendered in a vibrant orange color. The boy's outfit and the space shuttle are the main subjects of the image, and the overall composition is dynamic and engaging. LNTP style.

captions/23.txt

@@ -0,0 +1 @@
+A cartoon illustration of a man with a beard, wearing glasses, and a black shirt. The man is looking upwards with a serious expression on his face. The illustration is in a bright yellow background, giving it a vibrant and lively appearance. The man's beard is described as a goatee, and he is wearing a necklace. The style of the illustration is reminiscent of a comic book or graphic novel.

captions/3.txt

@@ -0,0 +1 @@
+A painting of a person wearing a mask and a hooded jacket, with a yellow lens flare in the background. The person is standing in front of an orange background, and the painting is done in a comic book style. The person is wearing a black jacket and a black mask, with a yellow lens flare in the background. The painting is done in a comic book style, with bold colors and exaggerated features. LNTP style.

captions/4.txt

@@ -0,0 +1 @@
+A cartoon illustration of a man wearing a black hoodie, a yellow headband, and green glasses. The man is wearing a black beard and has a frowning expression on his face. The image is drawn in a comic book style.

captions/5.txt

@@ -0,0 +1 @@
+A cartoon drawing of a cat wearing a black hat and green skin, with a yellow background. The cat is wearing a black jacket and has a green hat. The cat is looking to the side and appears to be angry. The drawing is in a comic book style.

captions/6.txt

@@ -0,0 +1 @@
+A digital illustration of a black cat wearing a black hat and a black suit. The cat is looking to the side with a green eye and a red nose. The cat is wearing a tie and has a mustache. The background is orange. LNTP style.

captions/7.txt

@@ -0,0 +1 @@
+A cartoon illustration of a black cat wearing a wizard's hat, green glasses, and a black coat. The cat is looking to the left, with its whiskers out. The cat is standing in front of a yellow background. The illustration is in a comic book style.

captions/8.txt

@@ -0,0 +1 @@
+A cartoon illustration of a cat wearing a black hat with a green background. The cat has a green face and is looking upwards. The cat is wearing a black hat with a yellow emblem on it. The illustration is in a comic book style.

captions/9.txt

@@ -0,0 +1 @@
+A cartoon illustration of a fat orange mouse with yellow eyes, sitting on a green background. The mouse is wearing black pants and a black shirt. The image is drawn in a comic book style.

config.yaml

@@ -5,28 +5,29 @@ config:
   - type: custom_sd_trainer
     training_folder: output
     device: cuda:0
-    trigger_word: latentpop style
+    trigger_word: LNTP
     network:
       type: lora
-      linear: 42
-      linear_alpha: 42
+      linear: 24
+      linear_alpha: 24
     save:
       dtype: float16
-      save_every: 5001
+      save_every: 1301
       max_step_saves_to_keep: 1
     datasets:
     - folder_path: input_images
       caption_ext: txt
       caption_dropout_rate: 0.05
       shuffle_tokens: false
-      cache_latents_to_disk: true
+      cache_latents_to_disk: false
+      cache_latents: true
       resolution:
       - 512
       - 768
       - 1024
     train:
-      batch_size: 1
-      steps: 5000
+      batch_size: 4
+      steps: 1300
       gradient_accumulation_steps: 1
       train_unet: true
       train_text_encoder: false
@@ -45,15 +46,15 @@ config:
       quantize: true
     sample:
       sampler: flowmatch
-      sample_every: 5001
+      sample_every: 1301
       width: 1024
       height: 1024
       prompts: []
       neg: ''
       seed: 42
       walk_seed: true
-      guidance_scale: 4
-      sample_steps: 20
+      guidance_scale: 3.5
+      sample_steps: 28
 meta:
   name: flux_train_replicate
   version: '1.0'

lora.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a8ce772ad1c47601cdbfc595c06b19fb765feba7ea0deacf38ed177758741d02
-size 451202760
+oid sha256:44eb014d7f58b0573578c64cba6d53a5824c69f63d3a3096f13a2c35c9483b60
+size 257887544