Assignment #5 - Cats Photo Editing

Part 1: Inverting the Generator

Combinations of the losses

Changing the Perpetual Loss while keeping the L1 loss at 10

TargetPerpetual Loss = 0Perpetual Loss = 0.01Perpetual Loss = 0.1Perpetual Loss = 1Perpetual Loss = 10

Looking at this output the perpetual loss was fixed to 0.01 which gave the best results.

Different generative models including vanilla GAN, StyleGAN

TargetVanilla GANStyleGAN

Looking at this outputs StylegGAN gave the best results.

Different latent space (latent code in z space, w space, and w+ space)

Targetzww+

Looking at the results w+ gives us the best results.

 

Part 2: Scribble to Image

Below are some results with the given set of images and some drawn images.

Sketch (S)Mask (M)Output

As we can see here using sketches with sparse lines and shapes gives good results.

Part 3: Stable Diffusion

Varied Noise

PromptInputNoise SD: 0.5Noise SD: 0.7
Grumpy cat reimagined as a royal painting
Dog reimagined as a royal painting

Varied Guidance

PromptInputGuidance: 5Guidance: 20
Grumpy cat reimagined as a royal painting
Dog reimagined as a royal painting