Learning spatial dimensions with a visual sensory aid: Molyneux revisited.

Area of Science:

• Auditory Perception
• Human-Computer Interaction
• Sensory Substitution

Background:

• Sensory aid research investigates how individuals learn to interpret artificial sensory information.
• Perceptual learning is crucial for adapting to and effectively using sensory substitution devices.

Purpose of the Study:

• To explore the relationship between sensory aid research and perceptual learning.
• To assess the learning curve and generalization capabilities when using a Binaural Sensory Aid (BSA).

Main Methods:

• Five experiments involved participants learning to reach for objects using a BSA.
• The BSA uses pitch for distance and interaural amplitude difference (IAD) for direction, with tactile error feedback.
• Training involved near-space reaching tasks with varying spatial regularities and target locations.

Main Results:

• Perceptual learning for both distance and direction cues was achieved within 72 trials.
• Performance with the BSA approached that of natural sound sources, though direction cue mastery required a second session.
• Learning was robust to spatial regularities but declined with only two target locations; single-dimension training impaired directional generalization.
• Pitch-distance learning generally surpassed IAD learning, likely due to better discriminability.

Conclusions:

• Individuals can rapidly learn to interpret sensory dimensions provided by devices like the BSA.
• Significant ability to generalize learned spatial information to new locations was observed.
• The findings highlight the potential of sensory aids in augmenting human spatial perception and interaction.