Dynamic Weighting of Time-Varying Visual and Auditory Evidence During Multisensory Decision Making

Area of Science:

• Cognitive Neuroscience
• Psychophysics
• Sensory Integration

Background:

• Perceptual decision-making involves integrating sensory evidence over time and across modalities.
• Understanding how different senses contribute to multisensory decisions is an ongoing research area.

Purpose of the Study:

• To investigate the temporal weighting of visual and auditory evidence in multisensory decision-making.
• To determine if sensory information contributes equally across time in audiovisual tasks.

Main Methods:

• A novel psychophysical task was developed to measure visual and auditory evidence weighting over time.
• Participants discriminated visual gratings and/or sounds with varying contrast and amplitude.
• Performance accuracy was compared between unisensory and multisensory trials.

Main Results:

• Multisensory trials significantly improved performance accuracy compared to unisensory trials.
• Early sensory evidence had the most substantial impact on decisions.
• The weighting of unisensory information dynamically shifted over time, showing periods of visual and auditory dominance.

Conclusions:

• Multisensory integration enhances perceptual decision-making through cross-modal interactions.
• Dynamic switching of sensory dominance occurs during audiovisual decision-making.
• Temporal dynamics of evidence weighting are critical for multisensory perception.