Prediction: CorrectPrediction: CorrectPrediction: CorrectPrediction: Incorrect (Predicted as Chair, probably due to the shape of the base resembling the bases of some rotating chairs in the dataset)| Comments:Prediction: Incorrect (Predicted as Vase, probably due to the vague conical shape resembling an inverted vase)| Comments:Prediction: Incorrect (Predicted as Vase, probably due to the vague conical shape resembling an inverted vase)| Comments:
Accuracy on Test Set: 0.9717
Interpretation & Explination of Results:
2. Segmentation
Figure 1 (0.9915)
Ground TruthPrediction
Figure 2 (0.9974)
Ground TruthPrediction
Figure 3 (0.9832)
Ground TruthPrediction
Figure 4 (0.4820)
Ground TruthPrediction (Model Fails on point clouds without visibly defined edges)
Figure 5 (0.4467)
Ground TruthPrediction (Model Fails on Assymetrical shapes, as evidenced due to the assymetry introduced due to the singular pillow on the right arm.)
Accuracy on Test Set: 91.13
3. Robustness Analysis
Classification: Rotating
New final test set accuracy: 0.7435 | Overall obsercations: Model is not rotation invariance
New final test set accuracy: 0.9698 | Overall observations: Model is able to adapt to varying point cloud densities, the model needs the general shape of the object in the point cloud to determine class label
Figure 1
Initial Prediction: CorrectReduced Density
Observation: Incorrect Prediction
Figure 2
Initial Prediction: CorrectReduced Density
Observation: Correct Prediction
Figure 3
Initial Prediction: CorrectReduced Density
Observation: Correct Prediction
Figure 4
Initial Prediction: CorrectReduced Density
Observation: Incorrect Prediction
Segmentation: 5000 Points
Figure 1 (0.9915 reduced to 0.9895)
Ground TruthInitial PredictionReduced Density Prediction
Figure 2 (0.9974 reduced to 0.9968)
Ground TruthPredictionReduced Density Prediction
Figure 3 (0.9832 increased marginally to 0.9941)
Ground TruthPredictionReduced Density Prediction
Figure 4 (0.4820 increased to 0.4924)
Ground TruthPrediction (Model Fails on point clouds without visibly defined edges)Reduced Density Prediction (Model continues to fail on point clouds without visibly defined edges, reducing density further worsens this)
Figure 5 (0.4467 reduced to 0.4438)
Ground TruthPrediction (Model Fails on Assymetrical shapes, as evidenced due to the assymetry introduced due to the singular pillow on the right arm.)Reduced Density Prediction (Model continues to fail on Assymetrical shapes, reduced point cloud density further worsens this.)
Reduced accuracy on Test Set: 0.9113 drops to 0.9042
