erwann/Face-editor · Apply for community grant: Personal project

Hey there , thanks for checking out this project :)
This is a lightweight latent face editor that runs on a T4. It uses VQGAN CLIP and extracted latent vectors to manipulate faces, with an interesting gradient-masked adversarial loss (implemented as custom backprop hooks). This allows the model to perform well on making masked edits that preserve source context. For example, changing hair color while preserving hairstyle, as opposed to hallucinating an entirely new hairstyle as diffusion inpainting models tend to do.

The model is very sensitive to the parameters, so I recommend experimenting with the advanced configs to find a setting that works !