Cross-modal influences on representational momentum and representational gravity

Area of Science:

• Cognitive Psychology
• Neuroscience
• Perception

Background:

• Representational momentum describes the displacement of remembered object locations in the direction of motion.
• Representational gravity refers to the displacement of remembered locations due to gravitational attraction.
• Cross-modal interactions in perception are increasingly recognized as crucial for cognitive functions.

Purpose of the Study:

• To investigate how cross-modal sensory information affects representational momentum and representational gravity.
• To determine if congruent or incongruent motion across sensory modalities influences memory displacement.
• To explore the high-level processing involved in these memory effects.

Main Methods:

• Experiment 1 paired ascending/descending visual motion with auditory motion (frequency space), testing memory for visual location or auditory pitch.
• Experiment 2 paired horizontal visual motion with ascending, descending, or no auditory motion, probing visual location memory.
• Participants' memory for location or pitch was assessed after cross-modal motion stimuli.

Main Results:

• Auditory motion congruence enhanced forward displacement for auditory pitch memory, but visual motion congruence did not affect visual location memory.
• Visual location memory was displaced downward with descending or no auditory motion.
• Downward displacement of visual location memory was greater when paired with descending auditory motion compared to ascending auditory motion.

Conclusions:

• Cross-modal sensory information significantly influences spatial and non-spatial memory displacements.
• The findings suggest that representational momentum and representational gravity are not solely low-level perceptual phenomena.
• These effects likely reflect sophisticated, high-level cognitive processing integrating information across sensory modalities.