Crossmodal Correspondence Mediates Crossmodal Transfer from Visual to Auditory Stimuli in Category Learning

Area of Science:

• Cognitive Psychology
• Neuroscience
• Sensory Perception

Background:

• Crossmodal correspondence describes sensory translation phenomena.
• Understanding crossmodal transfer and its relation to correspondence is crucial for cognitive science.

Purpose of the Study:

• Investigate if crossmodal correspondence mediates visual-to-auditory crossmodal transfer in category learning.
• Examine if multimodal category learning influences auditory-visual crossmodal correspondence.

Main Methods:

• Four experiments were conducted to test crossmodal transfer and correspondence.
• Stimuli included visual elevation/size and auditory pitch.
• Category learning paradigms were employed to assess transfer and correspondence shifts.

Main Results:

• Crossmodal transfer occurred between elevation and pitch stimuli, mediated by robust crossmodal correspondence.
• No crossmodal transfer was found between size and pitch, due to weak correspondence.
• Multimodal category learning influenced the direction of pitch-size correspondence, indicating its plasticity.

Conclusions:

• Crossmodal transfer is facilitated by robust crossmodal correspondence between stimuli.
• Multisensory category learning can alter existing crossmodal correspondences.
• Shared abstract representations, potentially semantic, underlie crossmodal transfer and correspondence.