Cross-modal correspondence between auditory pitch and visual elevation modulates audiovisual temporal recalibration

Area of Science:

• Cognitive Psychology
• Neuroscience
• Sensory Integration

Background:

• Cross-modal correspondences link features across senses (e.g., pitch and elevation).
• Audiovisual integration adapts to spatiotemporal conflicts, a process called recalibration.
• The role of cross-modal correspondence in audiovisual recalibration remains unclear.

Purpose of the Study:

• To investigate if cross-modal correspondence between auditory pitch and visual elevation influences audiovisual temporal recalibration.
• To determine if congruent pitch-elevation pairings are selectively recalibrated.

Main Methods:

• Participants adapted to temporally spaced audiovisual stimuli with manipulated pitch-elevation congruency.
• Judgments of subjective simultaneity (Point of Subjective Simultaneity - PSS) were assessed post-adaptation.
• Experiments manipulated the temporal order of stimuli to align with or contradict pitch-elevation correspondence.

Main Results:

• A significant shift in the Point of Subjective Simultaneity (PSS) was observed for congruent audiovisual stimuli after adaptation.
• This recalibration effect was absent for incongruent pitch-elevation pairings.
• Results suggest selective recalibration based on cross-modal correspondence.

Conclusions:

• Cross-modal correspondence selectively modulates audiovisual temporal recalibration.
• The brain recalibrates temporal perception to resolve conflicts in congruent audiovisual pairings.
• This finding highlights the influence of feature associations on sensory integration plasticity.