Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets

Area of Science:

• Auditory and visual spatial perception
• Human sensory integration
• Psychophysics

Background:

• Understanding the interplay between auditory and visual spatial perception is crucial for explaining human orientation and interaction with the environment.
• Previous research suggests a complex relationship between where we hear a sound and where we see it.

Purpose of the Study:

• To investigate the alignment of auditory and visual spatial perception.
• To determine how gaze direction influences sound localization accuracy.
• To identify factors contributing to discrepancies between perceived sound and visual target locations.

Main Methods:

• Four experiments were conducted using laser pointing to acoustic targets in a dark, anechoic room.
• Subjects fixated visual stimuli (LED or laser spot) while aiming a laser beam at the perceived azimuthal location of sound stimuli.
• Sound stimuli (bandpass-filtered noise) were presented from nine loudspeakers positioned laterally (±22 degrees).

Main Results:

• Systematic divergences between sound azimuth and laser adjustments were observed, influenced by experimental instructions.
• Auditory target eccentricity was generally overestimated by up to 10.4 degrees.
• Gaze direction significantly shifted laser adjustments (up to 5.6 degrees) towards the fixation point when the sound source was straight ahead, an effect diminishing with increasing sound eccentricity.

Conclusions:

• Auditory spatial perception is subject to lateral overestimation.
• Eye position significantly impacts sound localization, particularly for sounds originating from the front.
• The findings highlight the interactive effects of auditory overestimation, eye position, retinal eccentricity, and extraretinal eye position signals on spatial perception.