On the cross-modal perception of intensity

Area of Science:

• Psychophysics
• Sensory Perception
• Cross-modal Integration

Background:

• Understanding cross-modal perception is crucial for deciphering how the brain integrates sensory information.
• Previous research has debated whether cross-modal matching relies on absolute stimulus intensities or relative positions within sensory contexts.

Purpose of the Study:

• To investigate whether cross-modality matches are based on absolute intensity equivalences or relative stimulus positions.
• To determine the extent of absolute versus relative matching across different sensory modalities and stimulus types.

Main Methods:

• Conducted three experiments employing magnitude matching and cross-modal difference estimation.
• Manipulated stimulus magnitudes in one modality while systematically varying levels in another across sessions.
• Analyzed individual matching strategies, including absolute and relative comparison tendencies.

Main Results:

• Cross-modal matches represent a compromise between absolute equivalence and relative (contextual) comparison.
• The compromise ratio varied, with auditory loudness versus vibratory loudness and auditory loudness versus visual brightness showing a 50-50 split, while auditory duration versus visual duration leaned more towards absolute matching.
• Significant individual differences were observed, with some participants exhibiting purely absolute matching and others purely relative matching.

Conclusions:

• Cross-modal perception is not solely based on absolute intensity or relative context but a combination influenced by modality and stimulus type.
• Individual variability plays a substantial role in cross-modal matching strategies.
• A model of linear subtraction explained cross-modal difference judgments, and sequential response dependencies can account for context-induced changes.