Assignment 3

16-825 Learning for 3D Vision

Task 1.3

Grid Image

Grid Image

Rays Image

Rays Image

Task 1.4

Sample Points Image

Sample Points Image

Task 1.5

Part 1 Image

Part 1 gif

Depth Image

Depth Image

Task 2.3

Part 2 Image

Part 2 gif

Task 3

Part 3 Image

Part 3 gif

Task 4.1

Part 4_1 Image

Part 4.1 gif

In reality the color can change a little bit because of the lighting when the viewpoint changes. Adding viewpoint dependence can make this happen. If the view dependence is too strong, the network can memorize the training cameras instead of learning a color that stays consistent in 3D. If it is too weak, the model generalizes more easily, but the reflection may be less sharp.

Task 5.5

Part 5 Render Image

Part 5 Render gif

Task 6

{'params': [gaussians.pre_act_opacities], 'lr': 0.05, "name": "opacities"}, {'params': [gaussians.pre_act_scales], 'lr': 0.005, "name": "scales"}, {'params': [gaussians.colours], 'lr': 0.01, "name": "colours"}, {'params': [gaussians.means], 'lr': 0.0001, "name": "means"}

1000 iterations

Mean PSNR: 29.398, mean SSIM: 0.936.

Part 6 Training Progress Image

Part 6 Training Progress gif

Part 6 Test Results Image

Part 6 Test Results gif

Task 7.1

Part 5 Render Image

Part 5 Render gif

Part 7 Render Image

Part 7.1 Render gif

side-by-sdie 1

side-by-sdie 1

side-by-sdie 2

side-by-sdie 2

side-by-sdie 3

side-by-sdie 3

1: the upper area is different, sh one is darker. 2: the upper area is different, sh one is darker but slightly lighter than the previous one. 3: the upper image is different. The sh one is darker but lighter than the previous two. The original one does not change when the viewpoint changes, but the sh one can change.