When seeing a dog activates the bark: multisensory generalization and distinctiveness effects

Area of Science:

• Cognitive Psychology
• Neuroscience
• Sensory Perception

Background:

• The study investigates multisensory generalization, exploring how information processed in one sensory modality can influence perception in another.
• Understanding cross-modal interactions is crucial for comprehending complex cognitive functions and perceptual learning.

Purpose of the Study:

• To provide evidence for a multisensory generalization effect, where learning associated with one sensory modality generalizes to another.
• To examine how category learning and feature distinctiveness impact cross-modal generalization.

Main Methods:

• An innovative three-phase paradigm was employed: a learning phase involving shape-sound categorization, a priming task, and a recognition task.
• Participants categorized geometric shapes associated with specific sound features, followed by tests assessing priming and recognition of shapes and sounds.

Main Results:

• A multisensory generalization effect was observed: shapes learned with associated sounds enhanced processing of target sounds, even for shapes not presented with sound during learning.
• Recognition tasks showed impaired identification of shapes learned without sound, supporting the generalization effect.
• Experiment 1 confirmed multisensory generalization within categories sharing shape features, while Experiments 2a and 2b revealed a distinctiveness effect when salient features differentiated category members.

Conclusions:

• The findings support the existence of a multisensory generalization effect, demonstrating cross-modal transfer of learned associations.
• Category structure and feature distinctiveness play significant roles in modulating the extent and nature of multisensory generalization.