Questioning the automaticity of audiovisual correspondences

Area of Science:

• Cognitive Psychology
• Neuroscience
• Psychophysics

Background:

• Audiovisual correspondences (AVCs) describe consistent sensory feature matching across modalities (e.g., auditory pitch and visual size).
• Previous research often inferred automatic, bottom-up processing of AVCs based on faster classification with congruent stimuli.
• This inference is limited as it doesn't rule out top-down influences.

Purpose of the Study:

• To develop and apply a novel procedure to quantify both bottom-up and top-down processing in AVCs.
• To investigate the processing mechanisms underlying AVCs between auditory pitch and visual features (size, height, spatial frequency, brightness, angularity).

Main Methods:

• A new experimental procedure was designed to differentiate bottom-up and top-down influences in AVC processing.
• Studies examined AVCs between auditory pitch and five distinct visual features.
• Participant response times were analyzed to assess processing characteristics.

Main Results:

• All investigated AVCs, including pitch-size, pitch-height, pitch-spatial frequency, pitch-brightness, and pitch-angularity, exhibited both bottom-up and top-down processing.
• The findings indicate that AVCs are not solely automatic or bottom-up as previously generalized.

Conclusions:

• The prevalent assumption that audiovisual correspondences are exclusively automatic is challenged.
• AVCs involve a complex interplay of automatic (bottom-up) and controlled (top-down) cognitive processes.
• Future research should consider both processing types when studying multisensory integration.