Object #0 — 95.06%
The model largely separates the back, seat, and legs correctly. Remaining errors occur around connections between parts, where adjacent regions have similar coordinates and weak boundaries.
16-825 Learning for 3D Vision · Classification, segmentation, robustness, and locality
I implemented a PointNet classifier without transformation blocks. Shared pointwise layers map coordinates to 64, 128, and 1024 channels. Global max pooling produces an object descriptor, followed by fully connected layers of 512 and 256 units and three class logits. The model distinguishes chairs, vases, and lamps.
Test accuracy: 98.11% (935 / 953 objects), using 10000 points per object.


These explanations are hypotheses based on the visible geometry, rather than verified causes of the network’s decisions.
The PointNet segmenter combines a 64-channel feature at each point with a broadcast 1024-channel global max-pooled descriptor. Shared prediction layers produce six part logits per point. The task segments chair point clouds into six semantic part classes.
Test point accuracy: 90.35%, evaluated on 617 objects with 10000 points each.
The following five objects include two difficult predictions (#351 and #61). Accuracy is the fraction of correctly labeled points in each object.
| Test object | Point accuracy | Example |
|---|---|---|
| #0 | 95.06% | Test example |
| #1 | 98.72% | Test example |
| #2 | 89.60% | Test example |
| #351 | 44.55% | Difficult prediction |
| #61 | 46.28% | Difficult prediction |
Part 0Part 1Part 2Part 3Part 4Part 5
The model largely separates the back, seat, and legs correctly. Remaining errors occur around connections between parts, where adjacent regions have similar coordinates and weak boundaries.
The thin frame, seat, back, and armrests are mostly recovered. Their clear spatial separation makes this an easier case, although small errors remain around narrow junctions.
The main seat, back, and pedestal are recognizable, but the rounded seat shell blends into the back and side regions. These smooth transitions make precise part boundaries harder than in a simple frame chair.
This chair has a continuous, enclosing shell with broad side regions. The prediction labels much of the lower shell as leg/support points instead of recovering the ground-truth side structure, showing that global shape cues are insufficient for this unusual geometry.
The squat, box-like shape has a back and sides that are less distinct than those of a conventional chair. A large region is predicted as seat, with additional part confusion near the upper structure, producing a low accuracy despite a plausible overall outline.
I evaluated the fixed Q1 and Q2 PointNet checkpoints under two input perturbations, with no retraining. Classification accuracy is measured per object; segmentation accuracy is measured per point. The full, unrotated 10000-point input is the reference.
Procedure. Rotate each test point cloud about the vertical y axis through the origin by 45° and 90°. All 10000 points are retained, and point labels remain unchanged. The model is run in evaluation mode.
| Condition | Classification | Drop (pp) | Segmentation | Drop (pp) |
|---|---|---|---|---|
| Original (0°, 10000 points) | 98.11% | +0.00 | 90.35% | +0.00 |
| 45° rotation | 49.74% | +48.37 | 71.27% | +19.09 |
| 90° rotation | 36.73% | +61.39 | 57.30% | +33.06 |
Drops are measured in percentage points (pp). A negative drop indicates an improvement.

Interpretation. Rotation sharply reduces accuracy: at 90°, classification drops by 61.39 percentage points and segmentation by 33.06. PointNet’s max pooling is invariant to point ordering, but the coordinate-dependent features are not inherently rotation invariant. The results suggest that the models rely strongly on the canonical orientations seen during training.


The simple frame chairs retain some recognizable parts after rotation, but their labels become less consistent. Object #351 is already difficult before rotation and becomes worse, falling from 44.56% to 23.14% in this evaluation.


Procedure. Evaluate each model using 5000, 1000, and 256 points instead of 10000, without rotating the cloud. A fixed random seed (42) defines a common point permutation; smaller samples are nested subsets. Segmentation labels are selected with exactly the same indices. Segmentation accuracy is evaluated only on the retained points.
| Condition | Classification | Drop (pp) | Segmentation | Drop (pp) |
|---|---|---|---|---|
| Original (0°, 10000 points) | 98.11% | +0.00 | 90.35% | +0.00 |
| 5000 points | 98.22% | -0.10 | 90.41% | -0.05 |
| 1000 points | 97.90% | +0.21 | 90.36% | -0.01 |
| 256 points | 96.85% | +1.26 | 87.36% | +2.99 |

Interpretation. Both models are much more robust to reduced point density than to rotation. At 1000 points, classification remains at 97.90% and segmentation at 90.36%; at 256 points, they fall to 96.85% and 87.36%. Sparse inputs can omit fine geometry or points that contribute strongly to global max-pooled features. Small improvements at some densities reflect these particular subsets; one seed does not establish that fewer points are generally better.


Individual examples need not follow the aggregate trend. In particular, the apparent improvement for object #351 is measured on a different, smaller set of points and does not imply that the model now segments the discarded points correctly.




I implemented a compact DGCNN with three EdgeConv blocks of 64, 64, and 128 channels and a 256-channel embedding. At each block, a new k-nearest-neighbor graph (k = 20) is constructed in the current feature space. A shared network processes the edge feature [xᵢ, xⱼ − xᵢ], followed by max pooling over neighbors. This explicitly uses local relationships, while the first PointNet processes individual points before global pooling.
The classifier combines global max and mean pooled features. The segmenter concatenates the local EdgeConv features with a broadcast global descriptor and predicts six labels per point. This is a smaller adaptation of DGCNN, without a transformation network or category conditioning.
| Model | Training points per object | Classification accuracy | Segmentation accuracy |
|---|---|---|---|
| PointNet (Q1/Q2) | 10000 | 98.11% | 90.35% |
| Compact DGCNN | 5000 | 98.01% | 91.95% |
DGCNN correctly classifies 934 / 953 test objects. Relative to PointNet, classification changes by -0.10 percentage points, and segmentation improves by 1.60 percentage points.
The training settings differ in point count: PointNet uses 10000 points, while DGCNN uses 5000. The saved DGCNN segmentation evaluation also uses 5000 points per object. These results compare the obtained systems and do not isolate architecture alone. For context, Q3’s PointNet evaluation at 5000 points gives 98.22% classification and 90.41% segmentation; it was still trained on 10000 points.

DGCNN corrects the chair #406 and lamp #883 errors shown in Q1, but both models still confuse vase #716 with a lamp. Conversely, lamp #869 is correct for PointNet and incorrect for DGCNN. Local features help some shapes but do not eliminate the geometric ambiguity between lamps and vases, and the overall classification score does not improve.
The same five Q2 objects are shown below. Ground truth and PointNet use the original 10000-point clouds; DGCNN predictions use the saved 5000-point samples. The label colors are the same across models. Per-object accuracies use each model’s evaluated points.
| Test object | PointNet (10000 points) | DGCNN (5000 points) | Change (pp) |
|---|---|---|---|
| #0 | 95.06% | 95.24% | +0.18 |
| #1 | 98.72% | 99.30% | +0.58 |
| #2 | 89.60% | 87.86% | -1.74 |
| #351 | 44.55% | 48.46% | +3.91 |
| #61 | 46.28% | 56.04% | +9.76 |
Interpretation. Local relationships help DGCNN improve the simple frame examples (#0 and #1) and the difficult enclosing shapes (#351 and #61). Object #61 improves most among these examples, but its prediction still confuses a large region with the seat. The rounded chair #2 becomes slightly worse, showing that neighborhood features do not resolve every smooth part transition. The two difficult examples remain well below the overall accuracy, so locality helps without fully solving unusual part layouts.
Method reference: Wang et al., Dynamic Graph CNN for Learning on Point Clouds.