Visual-to-auditory sensory substitution with passive movements in a double participant setup

Area of Science:

• Cognitive Science
• Neuroscience
• Sensory Perception

Background:

• Action is crucial for perception in sensory substitution.
• Debate exists on whether perception requires voluntary action or if passive movements suffice.

Purpose of the Study:

• To investigate the role of active versus passive movements in visual-to-auditory sensory substitution.
• To determine if passive sensory input can lead to perceptual learning.

Main Methods:

• A visual-to-auditory sensory substitution device was used.
• A pantograph system facilitated simultaneous active and passive movement conditions.
• Participants recognized 2D shapes under both conditions.

Main Results:

• Participants improved shape recognition in both active and passive movement conditions.
• Perceptual learning occurred irrespective of whether movements were voluntary or passive.

Conclusions:

• Sensory substitution is effective even with passive movements.
• This challenges the notion that perception solely relies on voluntary sensorimotor interactions.