Sora (Blue Archive NPC)

Decided to try completely changing things up after seeing an anon's suggestions on /hdg/. Used batch size 12, lower resolution, and a high learning rate. Can't tell if it's any better or worse quality-wise than my usual LoRAs, but it was a lot faster to train.

Be forewardned that this LoRA is prone to generating NSFW results since Sora an unusually high proportion of very lewd art.

Usage

Didn't do much tag pruning so you have to prompt a lot.

Use any or all of the following tags to summon Sora: sora, halo, mini wings, white wings, two side up, blonde hair, forehead

For her usual outfit, blue apron, white shirt is typically enough. You can also add off-shoulder, strap slip, bowtie, short sleeves if desired.

Sometimes her wings appear too high; low wings can help with this. Her wings are also usually a bit too big but that's kind of hard to control.

Weight 1 seems to work fine.

Training

All parameters are provided in the accompanying JSON files.

Trained on a set of 128 images, repeated 25 times, 3 epochs (128 images * 25 repeats / 12 batch size * 3 epochs = 800 steps)
- Dataset included a mixture of SFW and NSFW.
Batch size 12 is up from usual of 3
Resolution was 512, down from usual of 832
General learning rate is 1.2e-3, significantly up from the Kohya default (1e-6 I believe)
- My understanding is that when this learning rate is set at the same time as the text encoder and unet rates, it is used only as one of the inputs to the AdamW optimizer, which adjusts the learning rate as necessary. So even though this value is high, it is not running at this value constantly.
Text encoder learning rate of 1.5e-5
Unet learning rate of 1.5e-4
constant_with_warmup scheduler instead of cosine
Initially tagged with WD1.4 Convnextv2 model. Tags minimally pruned/edited.
Used network_dimension 128 (same as usual) and network_alpha 64
Trained without VAE.