16-825: Learning for 3D Vision
Assignment 1: Rendering Basics with PyTorch3D
Submitted by: Kailash Jagadeesh (ID: kailashj)
Table of Contents
- Setup
- Practicing with Cameras
- Practicing with Meshes
- Re-texturing a Mesh
- Camera Transformations
- Rendering Generic 3D Representations
- Do Something Fun
- Extra Credit
0. Setup
The installation was successful with the gpu access enabled onto my local machine. Here is the attached render from the starter code to verify the functioning of the codebase.
Sample Cow Mesh Render
1. Practicing with Cameras (15 Points)
1.1 360-degree Renders (5 points)
GIF:
Here is the output gif for rendering multiple viewpoints for the cow mesh given.
1.2 Dolly Zoom (10 points)
GIF:
Answer:
The Dolly effect was created by modelling the relation between the FOV and distance and varying them.
Credits: Wikipedia
2. Practicing with Meshes (10 Points)
2.1 Tetrahedron (5 points)
GIF:
Answer:
- Number of vertices: 4
- Number of faces: 4
2.2 Cube (5 points)
GIF:
Answer:
- Number of vertices: 8
- Number of faces: 12
3. Re-texturing a Mesh (10 Points)
GIF:
Answer:
- Chosen
color1: [0, 0, 1] - Chosen
color2: [1, 0, 0]
4. Camera Transformations (10 Points)
Images:
Base Image:
- Transform 1: -90 degrees in Z axis
- Transform 2:90 degrees in Y Axis
- Transform 3: +K units in Z axis
- Transform 4: +K units in X axis and -K units in Y axis
5. Rendering Generic 3D Representations (45 Points)
5.1 Rendering Point Clouds from RGB-D Images (10 points)
GIFs:
- All Point Clouds Side by Side
5.2 Parametric Functions (10 + 5 points)
GIFs:
- Torus Point Cloud
- New Object of Choice- Mobius Strip
5.3 Implicit Surfaces (15 + 5 points)
GIFs:
- Torus (Implicit Mesh)
- Custom Implicit Object - Steiner Surface (funny looking 3D surface)
Answer:
- Tradeoffs between mesh vs. point cloud rendering:
- Speed: Meshes are faster.
- Quality: Meshes support better quality, can support photorealistic effects
- Memory: Meshes are more efficient
- Ease of use: Point clouds are easier to acquire
6. Do Something Fun (10 Points)
For something fun, I tried to render the scene from the anime Demon Slayer: Kimetsu no Yaiba where the demon slayers fall into the Infinity Castle with the demons trying to hunt them. Hope it is fun watching this.
The obj file was found online (credits to sketchfab) and I generated cinematic trajectories to traverse the mesh in a fun looking way (credits to chatgpt) for helping with generating the trajectories.
Please play the video to watch the render. Also watch in full screen!!!