Training Eye-Hand Coordination in Simulated Interception With Gaze-Informed Haptic Guidance

Area of Science:

• Robotics
• Human-Computer Interaction
• Motor Skill Learning

Background:

• Robotic platforms can aid eye-hand coordination (EHC) training, but often prove less effective than unassisted practice.
• Existing robotic EHC training faces challenges like delayed gaze-based predictions and unintuitive feedback.
• Effective robotic assistance requires minimizing delays and providing clear, actionable guidance.

Purpose of the Study:

• To develop and evaluate a novel robotic training paradigm using gaze-informed haptic guidance.
• To enhance EHC learning in a simulated spatiotemporally critical interception task.
• To overcome limitations of current robotic training methods by reducing latency and improving feedback intuitiveness.

Main Methods:

• Developed a robotic training paradigm incorporating a gaze interface with low latency (∼200ms) to track visual attention on moving objects.
• Implemented immediate kinesthetic feedback triggered by gaze detection to guide fine motor movements for interception.
• Compared the effectiveness of the novel robotic training paradigm against unassisted practice in user studies.

Main Results:

• The proposed paradigm significantly reduced the delay between user attention and robotic assistance.
• Participants using the robotic system demonstrated increased successful interceptions.
• User studies indicated enhanced skill acquisition with the gaze-informed haptic feedback system compared to unassisted practice.

Conclusions:

• The novel robotic training paradigm effectively enhances EHC skill acquisition in critical tasks.
• Low-latency gaze tracking combined with task-specific haptic feedback is crucial for effective robotic motor skill training.
• This approach offers a promising direction for developing more effective robot-assisted learning systems.