Auditory cues facilitate object movement processing in human extrastriate visual cortex during simulated self-motion:...

Area of Science:

• Neuroscience
• Cognitive Science
• Visual Perception

Background:

• Segregating moving objects during self-motion is computationally challenging.
• Auditory cues can improve visual motion perception, but underlying neural mechanisms are unclear.

Purpose of the Study:

• To investigate how auditory motion cues facilitate visual motion detection during self-motion.
• To identify brain mechanisms and visual processing stages involved in crossmodal motion perception.

Main Methods:

• Used multivariate pattern analysis (MVPA) on MRI-informed magnetoencephalography (MEG) source estimates.
• Participants identified target object motion (forward/backward) in a simulated self-motion visual scene.
• Recorded brain activity using MEG during visual and auditory cue presentation.

Main Results:

• Auditory cues improved behavioral accuracy in localizing the target object.
• MEG source activity in visual areas V2 and hMT+ was significantly modulated by auditory cues.
• MVPA decoding accuracy of target movement direction from hMT+ activity increased with auditory cues.

Conclusions:

• Crossmodal auditory cues facilitate parsing object motion from self-motion-induced optic flow.
• This facilitation occurs in the human extrastriate visual cortex, specifically involving hMT+.
• Suggests crossmodal influences from the auditory system modulate visual motion processing.