Learning for 3D Vision: HW4

1. 3D Gaussian Splatting

1.1 3D Gaussian Rasterization

Chair

1.2 Training 3D Gaussian Representations

Truck Truck
Learning rates: Number of training iterations: 1000
Evaluation metrics:

1.3 Extensions: Rendering Using Spherical Harmonics

Without View Dependent Colours (same as before)

With View Dependent Colours (using Spherical Harmonics)

Frame number Without View Dependent Colors With View Dependent Colors Differences
5 Chair without view dependent colors Chair with view dependent colors There are new shadows in the left side of the chair, both on the back and on the seat
13 Chair without view dependent colors Chair with view dependent colors The chair looks a lot less brighter from this angle with the view dependent colors
18 Chair without view dependent colors Chair with view dependent colors The details at the front edge of the seat are less distinguisable from this angle under the view dependent rendering. Also, there is more contrast between the shadowed regions and the rest of the chair.

2. Diffusion-guided Optimization

2.1 SDS Loss + Image Optimization

Prompt Without Guidance With Guidance
a hamburger a hamburger
400 iterations
a hamburger
2000 iterations
a standing corgi dog a corgi
1600 iterations
a corgi
2000 iterations
a surfer surfer
2000 iterations
surfer
2000 iterations
Eren Yeager in titan form eren
1500 iterations
eren

2.2 Texture Map Optimization for Mesh

Prompt a light blue cow a cow with a shinning red head and a matte white body
Rendering cow cow

2.3 NeRF Optimization

Prompt RGB Rendering Depth Rendering
a standing corgi dog
an angry octopus
a jumping kitten

2.4 Extensions: View-dependent text embedding

Prompt Has view-dependent text embedding RGB Rendering Depth Rendering
a standing corgi dog No
Yes
a jumping kitten No
Yes