extensions/SD-Advanced-Noise/README.md

Colored Noise / Advanced Noise / Latent Noise Experiments

It is only fair that I shout out that all the other noise related repos such ash ComfyUI_Noise, noise_latent_perlinpinpin and comfy-plasma. I think the WAS node suite also has quite a few noise-related nodes.

While messing around with the stable diffusion VAE, I noticed the latent space behaves mostly linearly. I figured it should be possible to generate latent noise directly if I map out the per channel limits and give the whole thing an offset.

This repo also has some decoders, but those are a proof of concept tier at best. TAESD is better in every way.

LatentGaussianNoise

I'm not sure if the way I coded this even makes sense, or if it's even gaussian noise. It's just torch.random with a bunch of stuff like scaling/per channel random/etc.

Linearity / linear_encoder

This is the simplest encoder. It uses the fact that a change in the RGB channels creates a (mostly?) linear change in the 4 latents channels (which I just called A/B/C/D since I couldn't find any info about them).

The next step would be to plot at a higher precision and fit them onto a polynomial.