ITap: Index Finger Tap Interaction by Gaze and Tabletop Integration

Area of Science:

• Human-Computer Interaction
• Virtual Reality
• Augmented Reality

Background:

• Gaze-based interaction in XR often suffers from fatigue and accuracy issues, especially in complex environments.
• Traditional methods like gaze + pinch lack efficiency for precise control and prolonged tasks.

Purpose of the Study:

• To introduce ITap, a novel interaction method combining hand tracking and gaze input for enhanced XR interaction.
• To evaluate ITap's effectiveness in improving object selection speed, accuracy, user comfort, and reducing fatigue compared to traditional methods.

Main Methods:

• Developed ITap, a system using hand tracking for a virtual tabletop touchpad and gaze for selection, with a pinch gesture for manual control.
• Conducted two user studies comparing ITap against the traditional gaze + pinch method for object selection, scrolling, and swiping tasks.

Main Results:

• ITap significantly improved object selection speed and reduced errors, particularly with distant or densely packed objects.
• Participants reported higher comfort and less fatigue with ITap during prolonged scrolling and swiping tasks.

Conclusions:

• ITap offers a more efficient, accurate, and comfortable interaction method for XR environments compared to traditional gaze + pinch.
• The integration of gaze and touch gestures in ITap is well-suited for complex XR tasks and extended use, reducing user fatigue.