Increasing visual uncertainty modulates multisensory decision-making

The brain integrates and transforms information from multiple senses to make optimal decisions, a process that is critical for navigating complex environments with perceptual uncertainty. Despite a growing consensus that individuals adapt flexibly to uncertain sensory input, whether increasing visual uncertainty influences the decision process itself or other, non-decision sensory processes during multisensory decision-making are unclear. Here, an audiovisual categorization task was used to examine the responses of human participants (N = 30) to visual and audiovisual stimuli under low-, medium-, and high-uncertainty conditions. Modeling the behavioral data using a drift‒diffusion model indicated that increased visual uncertainty in the audiovisual context decreased the evidence accumulation rate but had no effect on non-decision processes. Electrophysiological recordings confirmed and expanded upon these results: increased visual uncertainty in the audiovisual context reduced the amplitude during the late decision-making stage (300-380 msec) but had no effect on the amplitude during the early sensory encoding stage (140-220 msec). More importantly, electroencephalography analyses revealed that audiovisual integration in the early sensory encoding stage occurred robustly across all visual uncertainty conditions, whereas audiovisual integration in the late stage occurred only under medium and high visual uncertainty conditions. This study demonstrated that increased visual uncertainty modulates the decision process itself rather than early sensory encoding during multisensory decision-making. Moreover, multisensory integration strategies dynamically adapt to increasing visual uncertainty by engaging different mechanisms to maintain effective decision-making.