Real-time occlusion handling in augmented reality based on an object tracking approach

Area of Science:

• Computer Vision
• Augmented Reality
• Human-Computer Interaction

Background:

• Realistic augmented reality (AR) requires accurate spatial relationships between real and virtual objects.
• Occlusion handling is critical for seamless integration of virtual elements into real-world views.

Purpose of the Study:

• To propose a novel, real-time occlusion handling method for augmented reality.
• To improve the realism and immersion of augmented reality experiences through accurate object integration.

Main Methods:

• A three-step approach: interactive segmentation for occluding object selection, real-time contour tracking, and pixel redrawing for occlusion management.
• Utilizes an object tracking approach for dynamic occlusion resolution.

Main Results:

• The method achieves robust and stable performance across significant camera movements and challenging color similarities.
• Real-time tracking enables fast processing, crucial for interactive AR applications.
• A smoothing technique ensures seamless visual merging between real and virtual objects.

Conclusions:

• The proposed real-time occlusion handling method effectively enhances the realism of augmented reality.
• Its robustness, speed, and seamless merging capabilities make it suitable for practical AR applications.