Related Experiment Video
Updated: May 16, 2025

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Common brain representations of action and perception investigated with cross-modal classification of newly learned
Yu-Hsin Fiona Chang1,2, Fredrik Ullén3,4, Örjan de Manzano3,4
1Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany. yu-hsin.chang@ae.mpg.de.
Abstract:
An important feature of human cognition is the ability to predict sensory outcomes of motor actions and infer actions from sensory information - a process enabled by action-perception coupling. Through repeated and consistent sensory feedback, bidirectional sensorimotor associations can become highly automatic with experience. In musicians, for instance, auditory cortex activity can increase spontaneously even when observing piano playing without auditory feedback. A key question is whether such associations rely on shared neural representations, or a "common code", between actions and their sensory outcomes. To test this, we trained non-musicians to play two melodies with different pitch sequences on the piano. The following day, they underwent an fMRI experiment with an MR-compatible piano while (a) playing the trained melodies without auditory feedback but imagining the sound, and (b) listening to the same melodies without playing but imagining the finger movements. Within-condition multivariate pattern analyses revealed that patterns of activity in auditory-motor regions represent pitch sequences. Importantly, cross-modal classification showed that these patterns generalized across conditions in the right premotor cortex, indicating the emergence of a common code across perception and action.
Related Concept Videos
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Perception
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
Synesthesia
Associative Learning
Classical conditioning, also known...

