Effects of User Perspective, Visual Context, and Feedback on Interactions With AR Targets on Magic-Lens Displays

Area of Science:

• Human-Computer Interaction
• Augmented Reality
• Haptic Feedback

Background:

• Performing close-range tasks with augmented content on 2D displays is challenging due to missing 3D visual information.
• Conventional displays render from a fixed device perspective, limiting depth perception during physical interactions.
• Haptic feedback, prior knowledge, and visual context influence task performance, but depth cues are often insufficient.

Purpose of the Study:

• To investigate if rendering augmented reality content from the user's perspective can improve depth perception and task performance.
• To compare user-perspective rendering with conventional device-perspective rendering in haptic interaction tasks.
• To evaluate the effectiveness of user-perspective rendering in a practical application, such as a simulated medical procedure.

Main Methods:

• A user study with 20 participants was conducted using a magic-lens display.
• Two experiments were performed: one measuring touchpoint and depth estimation accuracy, and another validating the method in a needle injection task.
• User-perspective rendering was compared against the conventional device-perspective rendering, with and without visual context and haptic feedback.

Main Results:

• User-perspective rendering slightly improved touch accuracy on physical surfaces.
• A significant improvement in interaction accuracy was observed when tactile feedback was absent.
• The benefits of user-perspective rendering were more pronounced in the absence of environmental visual context.
• The needle injection simulation showed increased accuracy with user-perspective rendering.

Conclusions:

• User-perspective rendering on magic lenses enhances immediate performance in haptic tasks.
• This approach is particularly beneficial for tasks in dynamic environments or those with short durations.
• Re-enabling depth cues through user-perspective rendering offers a significant advantage for augmented reality-assisted physical interactions.