Distinct audio and visual accumulators co-activate motor preparation for multisensory detection.

Area of Science:

• Neuroscience
• Cognitive Science
• Sensory Processing

Background:

• Detecting stimuli in multisensory environments is crucial for survival.
• The neural mechanisms underlying multisensory integration and evidence accumulation remain incompletely understood.
• It is unclear if different sensory modalities utilize distinct accumulation processes and decision criteria.

Purpose of the Study:

• To investigate whether auditory and visual evidence are accumulated through separate neural processes.
• To determine if these distinct accumulation processes are governed by independent decision criteria.
• To elucidate the interaction between modality-specific evidence accumulation and motor response initiation.

Main Methods:

• Two experiments involving audio-visual detection tasks (redundant and conjunctive conditions).
• Utilized a paradigm to trace neural evidence accumulation via centro-parietal positivity.
• Employed joint neural-behavioral modeling and an onset-asynchrony experiment.

Main Results:

• Auditory and visual evidence are accumulated in distinct neural processes during multisensory detection.
• Cumulative evidence from both modalities sub-additively co-activates a single, thresholded motor process.
• Evidence supports separate accumulation but shared motor initiation for multisensory detection.

Conclusions:

• The brain employs distinct accumulation mechanisms for auditory and visual sensory information.
• A unified, thresholded motor process integrates evidence from separate sensory streams for action.
• Findings clarify fundamental principles of information integration in multisensory perception.