Motion segmentation of RGB-D sequences: Combining semantic and motion information using statistical inference

Area of Science:

• Computer Vision
• Robotics
• Artificial Intelligence

Background:

• Accurate motion segmentation in dynamic RGB-D videos is crucial for scene understanding.
• Existing methods often overlook static, small, or slow-moving objects, impacting overall segmentation performance.

Purpose of the Study:

• To develop an innovative method for motion segmentation in RGB-D videos, focusing on improved detection of static, small, and slow-moving objects.
• To enhance motion segmentation accuracy by incorporating semantic information and robust motion analysis.

Main Methods:

• Combines semantic object-based segmentation with motion cues to estimate object counts and motion parameters.
• Employs selective object-based sampling and correspondence matching for object-specific motion estimation.
• Utilizes statistical inference theory to identify and group objects exhibiting similar motion patterns, mitigating over-segmentation.

Main Results:

• Demonstrates improved motion segmentation accuracy for small objects on the SBM-RGBD dataset.
• Shows competitive overall segmentation performance.
• An ablation study on the TUM-RGBD dataset highlights the significance of including static objects for SLAM (Simultaneous Localization and Mapping) accuracy.

Conclusions:

• The proposed method effectively segments multiple moving objects in RGB-D videos, particularly excelling with small or slow-moving targets.
• Integrating static objects and employing statistical inference for motion similarity assessment significantly improves segmentation robustness and accuracy.
• This approach offers a more comprehensive solution for motion segmentation in complex dynamic scenes.