Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA...

Area of Science:

• Computer Science
• Human-Computer Interaction
• Electrical Engineering

Background:

• Augmented reality (AR) significantly enhances efficiency, with visual AR commonly using handheld or head-mounted devices.
• Spatial augmented reality (SAR) offers advantages over wearable AR, including a wider field of view and hands-free operation, but lacks effective methods for projecting references.
• Current SAR systems struggle to provide on-demand references without relying on static surfaces for projection.

Purpose of the Study:

• To propose and demonstrate a novel spatial augmented reality (SAR) approach for contextualizing projected references in real-time and on demand.
• To apply this SAR method to the task of safe inspection of printed circuit board assembly (PCBA) using a wireless network.
• To enhance remote inspection guidance by wirelessly integrating with an automatic optical inspection (AOI) system.

Main Methods:

• Developed a novel SAR system capable of contextualizing projected references in real-time and on demand.
• Integrated the system with a wireless network and a remote automatic optical inspection (AOI) system for PCBA inspection.
• Utilized switchable glass to display augmented reality elements, including a rectangular bracket for defect localization and a reference image for guidance.

Main Results:

• The system successfully provided prompt guidance to inspectors by augmenting defect information (bracket and reference image) wirelessly.
• User study results demonstrated that the contextualization approach positively impacted inspection performance and user preference, outperforming the state-of-the-art.
• The system exhibited robustness, precision, and performance, supporting various visualization needs without requiring additional calibration.

Conclusions:

• The proposed novel SAR approach effectively addresses the challenge of providing contextualized, on-demand references in a hands-free manner.
• The system enhances the safety and efficiency of PCBA inspection by integrating wireless AOI data with real-time AR guidance.
• The developed SAR system offers a versatile and robust solution for complex visualization tasks, showing significant user preference and improved performance.