Related Experiment Video
Updated: Aug 13, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Cross-modal compatibility effects with visual-spatial and auditory-verbal stimulus and response sets
R W Proctor1, A Dutta, P L Kelly
1Psychology Department, Purdue University, West Lafayette, IN 47907-1364.
Abstract:
Within the visual-spatial and auditory-verbal modalities, reaction times to a stimulus have been shown to be faster if salient features of the stimulus and response sets correspond than if they do not. Accounts that attribute such stimulus-response compatibility effects to general translation processes predict that similar effects should occur for cross-modal stimulus and response sets. To test this prediction, three experiments were conducted examining four-choice reactions with (1) visual spatial-location stimuli assigned to speech responses, (2) speech stimuli assigned to keypress responses, and (3) symbolic visual stimuli assigned to speech responses. In all the experiments, responses were faster when correspondence between salient features of the stimulus and response sets was maintained, demonstrating that similar principles of translation operate both within and across modalities.
Related Concept Videos
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Visual Agnosia
Chunking and Rehearsal in Sensory Memory
Non-Verbal Cues
Causes of Similarity-Dissimilarity Effect

