Visualizing simultaneous eye-hand movements in a MATLAB dashboard

Area of Science:

• Neuroscience
• Biomedical Engineering
• Rehabilitation Technology

Background:

• Eye-hand coordination (EHC) is vital for daily activities, with its mechanisms under intense study.
• Analyzing simultaneous eye and hand movements offers insights into EHC, particularly for individuals with impaired dexterous control (e.g., stroke, TBI).
• Existing motion-capture and eye-tracking technologies lack automated methods for visualizing concurrent eye and hand movement data.

Purpose of the Study:

• To develop an automated method for visualizing concurrent eye- and hand-movement data.
• To create a MATLAB-based dashboard for near-instantaneous analysis and visualization of eye and hand-tracking data.
• To facilitate the understanding and investigation of EHC through side-by-side, time-locked comparisons.

Main Methods:

• Development of a MATLAB-based dashboard for data visualization.
• Collection of continuous eye movement data.
• Collection of continuous hand movement data.
• Combining datasets to display time-locked eye-hand data in a single dashboard.

Main Results:

• The developed dashboard enables near-instantaneous analysis and visualization of eye and hand-tracking data.
• The tool facilitates side-by-side and time-locked comparison of eye/hand movements.
• The dashboard visualizes timing and spatio-temporal errors in eye-hand movements.

Conclusions:

• The MATLAB dashboard provides a novel solution for visualizing concurrent eye and hand movement data.
• The tool has the potential to significantly aid in understanding and investigating EHC.
• Offers novel opportunities for both research and clinical applications in EHC assessment and rehabilitation.