Visual Mislocalization of Moving Objects in an Audiovisual Event

Area of Science:

• Psychology
• Neuroscience
• Cognitive Science

Background:

• The stream/bounce display (SBD) allows perception of visual objects either streaming or bouncing.
• Auditory stimuli can influence visual perception, but typically require temporal offsets.

Purpose of the Study:

• To investigate how auditory tones affect visual object localization in the SBD.
• To determine if crossmodal mislocalization occurs without temporal audiovisual offsets.

Main Methods:

• Manipulated tone presentation timing relative to object closest approach in the SBD.
• Asked observers to judge object overlap and perceived motion (stream, bounce, reverse).
• Compared results to known mislocalization phenomena.

Main Results:

• Tones near object closest approach biased judgments toward non-overlapping and overestimation of distance.
• A stronger bias towards direction change judgments (bounce/reverse) was observed.
• The mislocalization effect occurred without temporal offsets and was specific to opposing trajectories.

Conclusions:

• Demonstrates a novel form of crossmodal mislocalization without temporal audiovisual offsets.
• Highlights complex audiovisual interactions beyond simple one-to-one stimulus pairings.
• Suggests auditory tones can alter spatial judgments of complex visual motion.