Precise Haptic Device Co-Location for Visuo-Haptic Augmented Reality.

Area of Science:

• Human-Computer Interaction
• Augmented Reality
• Haptics

Background:

• Visuo-haptic augmented reality (AR) systems integrate digital information with the real world, allowing users to both see and interact tactilely.
• PHANToM haptic devices are commonly used for tactile feedback in these systems.
• Accurate co-location between virtual graphics and the haptic stylus is critical for a realistic user experience, but is often hindered by calibration inaccuracies.

Purpose of the Study:

• To present a comprehensive calibration procedure for visuo-haptic AR systems.
• To improve the precise co-location of the haptic stylus with computer-generated graphics.
• To enhance the robustness and usability of the calibration process.

Main Methods:

• Developed a calibration procedure that compensates for non-linear position errors from joint angle sensors.
• Extended compensation to include errors from gimbal sensors and improved overall position calibration.
• Incorporated software-based temporal alignment of sensor data and a novel reference estimation method for increased robustness against initialization and tracker noise.

Main Results:

• The proposed procedure significantly enhances the co-location accuracy of the haptic stylus compared to state-of-the-art methods.
• Evaluated extensively using two PHANToM devices, two optical trackers, and one mechanical tracker.
• Achieved higher fidelity visual and haptic augmentations.

Conclusions:

• The advanced calibration method substantially improves stylus co-location in visuo-haptic AR systems.
• This leads to more realistic and effective visual and haptic feedback.
• The findings are crucial for applications requiring fine-motor skills, such as medical simulators, assembly planning, and rapid prototyping.