The skin as a medium for sensory substitution

Area of Science:

• Neuroscience
• Biomedical Engineering
• Human-Computer Interaction

Background:

• Sensory substitution devices (SSDs) aim to restore function for individuals with sensory loss, particularly vision impairment.
• Tactile-visual SSDs convert camera input into tactile stimuli on the skin, mimicking visual information.
• Despite optimism, the potential of SSDs faces significant challenges.

Purpose of the Study:

• To critically evaluate the feasibility of general-purpose tactile-visual sensory substitution.
• To identify fundamental limitations in processing tactile information for complex visual tasks.
• To propose alternative applications for tactile sensory substitution.

Main Methods:

• Review of existing literature on sensory substitution, tactile perception, and cortical plasticity.
• Analysis of perceptual, attentional, and cognitive constraints on skin-based information processing.
• Theoretical argumentation regarding the limitations of current and future tactile SSDs.

Main Results:

• Fundamental perceptual, attentional, and cognitive limitations hinder the skin's ability to process high-rate, spatiotemporal visual information.
• Cortical plasticity, while significant, shows limited capacity to overcome these tactile processing constraints.
• The skin surface is unlikely to support general-purpose visual sensory substitution.

Conclusions:

• The application of tactile sensory substitution is likely to be confined to special-purpose devices.
• These specialized devices could enhance specific activities like navigation, locomotion control, and pattern perception.
• Further research should focus on developing targeted tactile solutions rather than aiming for full visual replacement.