Brief Sensory Training Narrows the Temporal Binding Window and Enhances Long-Term Multimodal Speech Perception

Area of Science:

• Neuroscience
• Cognitive Science
• Perception

Background:

• The brain integrates multisensory information for a holistic perception, a process complicated by varying signal speeds and processing times.
• The temporal binding window (TBW) reflects the brain's temporal tolerance for integrating stimuli from the same event.
• TBW plasticity is crucial for understanding audio-visual illusions, synesthesia, and psychiatric disorders.

Purpose of the Study:

• To investigate how perceptual training, varying in length and modality (unisensory vs. multisensory), affects the TBW in healthy individuals.
• To examine the impact of TBW on speech intelligibility, specifically the integration of auditory and visual speech cues.
• To assess the long-term effects of training on TBW and speech perception.

Main Methods:

• Three audio-visual paradigms were employed to train participants.
• Training involved varying durations (short vs. long) and sensory modalities (unisensory vs. multisensory).
• Speech intelligibility was measured using integrated auditory and visual speech information from video recordings.

Main Results:

• Simple sensory training successfully altered the TBW, optimizing speech perception.
• Multisensory training significantly narrowed the TBW more than unisensory training; training length had no differential effect.
• A narrower TBW correlated with enhanced speech perception, indicating improved cross-modal integration, especially when one modality was impaired.
• All observed effects were sustained for at least seven days.

Conclusions:

• Perceptual training, particularly multisensory, can effectively modify the TBW and enhance speech perception in ecologically relevant scenarios.
• The findings underscore the importance of multisensory temporal processing for real-world perception.
• These results have significant clinical implications for conditions involving impaired multisensory temporal function, such as autism and schizophrenia.