3D Shape Completion on Unseen Categories: A Weakly-Supervised Approach

Area of Science:

• Computer Vision
• 3D Reconstruction
• Machine Learning

Background:

• 3D shape completion is crucial for handling incomplete data from scanning devices.
• Existing methods struggle with generalization to unseen object categories due to limited training data.
• Occlusion is a significant challenge in acquiring complete 3D shape information.

Purpose of the Study:

• To develop a novel weakly-supervised framework for reconstructing complete 3D shapes from unseen categories.
• To improve the generalization capability of 3D shape completion algorithms.
• To address the limitations of current methods in handling diverse object categories.

Main Methods:

• An end-to-end prior-assisted shape learning network infers a coarse shape using a prior bank of seen categories.
• A multi-scale pattern correlation module analyzes local patterns for shape learning.
• A self-supervised shape refinement model utilizes category-specific priors and a voxel-based partial matching loss.

Main Results:

• The proposed framework successfully reconstructs complete 3D shapes from unseen categories.
• Experimental results demonstrate superior performance compared to state-of-the-art methods.
• The approach shows significant improvements in handling incomplete 3D data.

Conclusions:

• The novel weakly-supervised framework offers a robust solution for 3D shape completion across diverse categories.
• The method effectively leverages prior knowledge and self-supervision for accurate shape reconstruction.
• This work advances the field of 3D shape completion, particularly for generalizing to novel object types.