Multipurpose Spatiomotor Capture System for Haptic and Visual Training and Testing in the Blind and Sighted

Area of Science:

• Rehabilitation Engineering
• Human-Computer Interaction
• Neuroscience

Background:

• Visually impaired individuals require specialized tools for spatial memory and motor control training.
• Existing methods for assessing these skills are often manual and lack integrated quantitative feedback.
• There is a need for automated systems to evaluate the complete 'perception-cognition-action' loop.

Purpose of the Study:

• To develop and describe a multipurpose haptic stimulus delivery and spatiomotor recording system.
• To enable quantitative assessment of spatial memory and precise motor control for blindness rehabilitation.
• To provide an integrated platform for STEM learning, navigation training, and map reading.

Main Methods:

• Development of a system with tactile map-overlays and a touch-tablet interface.
• Utilizing capacitive coupling for precise recording of hand movements and drawing trajectories.
• Automated analysis of navigational errors, speed, and time elapsed during haptic exploration and drawing tasks.

Main Results:

• The system enables precise, automated quantitative assessment of the 'perception-cognition-action' loop.
• It allows for detailed analysis of non-visual exploration, spatial memory encoding, and spatiomotor control.
• Accuracy of memory encoding can be specifically assessed through a memory-drawing operation.

Conclusions:

• This innovative system offers an integrated and automated approach to evaluating spatial cognition and motor skills.
• It holds significant potential for blindness rehabilitation, STEM education, and navigation training for both visually impaired and sighted individuals.
• The system provides a comprehensive tool for understanding and improving non-visual perception, memory, and action.