Audiovisual integration in hemianopia: A neurocomputational account based on cortico-collicular interaction

Area of Science:

• Neuroscience
• Computational Neuroscience
• Vision Science

Background:

• Hemianopic patients exhibit audiovisual integration in their blind hemifield.
• This integration includes auditory enhancement of visual detection and visual enhancement of auditory localization.
• Neural mechanisms underlying these phenomena require further elucidation.

Purpose of the Study:

• To investigate the neural mechanisms of audiovisual integration in hemianopia using a neural network model.
• To determine the roles of cortical and subcortical structures, including the Superior Colliculus (SC) and V1, in these integration processes.
• To simulate hemianopic patients by modeling V1 lesions and analyzing the impact of residual V1 tissue.

Main Methods:

• Development of a neural network model incorporating retinal, V1, extrastriate visual cortex, auditory cortex, and SC neurons.
• Simulation of hemianopia through unilateral V1 lesioning, with consideration for spared V1 islands.
• Sensitivity analyses to disentangle the contributions of specific neural circuits and areas.

Main Results:

• The model successfully reproduced audiovisual integration phenomena observed in hemianopic patients.
• SC-cortical connections were identified as crucial for both auditory enhancement of visual detection and visual enhancement of auditory localization.
• Auditory enhancement of visual detection depended on surviving V1 islands, whereas visual enhancement of auditory localization persisted even after complete V1 damage.

Conclusions:

• SC-cortical pathways play a common, critical role in audiovisual integration in hemianopia.
• Visual cortices, particularly V1, have differential roles in the two audiovisual integration phenomena.
• The findings advance understanding of audiovisual interactions in both healthy and visually impaired conditions.