Related Experiment Video
Updated: Jun 3, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
A taste of words: linguistic context and perceptual simulation predict the modality of words
1Department of Psychology/Institute for Intelligent Systems, University of Memphis, Psychology Building, Memphis, TN 38152, USA. mlouwerse@memphis.edu
Abstract:
Previous studies have shown that object properties are processed faster when they follow properties from the same perceptual modality than properties from different modalities. These findings suggest that language activates sensorimotor processes, which, according to those studies, can only be explained by a modal account of cognition. The current paper shows how a statistical linguistic approach of word co-occurrences can also reliably predict the category of perceptual modality a word belongs to (auditory, olfactory-gustatory, visual-haptic), even though the statistical linguistic approach is less precise than the modal approach (auditory, gustatory, haptic, olfactory, visual). Moreover, the statistical linguistic approach is compared with the modal embodied approach in an experiment in which participants verify properties that share or shift modalities. Response times suggest that fast responses can best be explained by the linguistic account, whereas slower responses can best be explained by the embodied account. These results provide further evidence for the theory that conceptual processing is both linguistic and embodied, whereby less precise linguistic processes precede precise simulation processes.
Related Concept Videos
Factors Affecting Perception
An illustrative example of a perceptual set is the scenario where an airline pilot told...
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Introduction to Special Senses
Language and Cognition
Synesthesia
Components of Language
