Related Experiment Video
Updated: Jan 11, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Cross-modal deep generative models reveal the cortical representation of dancing
Yu Takagi1,2,3,4,5, Daichi Shimizu6, Mina Wakabayashi7
1Department of Psychology, Graduate School of Humanities and Sociology, The University of Tokyo, Tokyo, Japan. yutakagi322@gmail.com.
Abstract:
Dance is an ancient, holistic art form practiced worldwide throughout human history. Although it offers a window into cognition, emotion, and cross‑modal processing, fine‑grained quantitative accounts of how its diverse information is represented in the brain have rarely been performed. Here, we relate features from a cross‑modal deep generative model of dance to functional magnetic resonance imaging responses while participants watched naturalistic dance clips. We demonstrate that cross-modal features explain dance‑evoked brain activity better than low‑level motion and audio features. Using encoding models as in silico simulators, we quantify how dances that elicit different emotions yield distinct neural patterns. While expert dancers' brain activity is more broadly explained by dance features than that of novices, experts exhibit greater individual variability. Our approach links cross-modal representations from generative models to naturalistic neuroimaging, clarifying how motion, music, and expertise jointly shape aesthetic and emotional experience.
Related Concept Videos
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
Somatosensory, Motor, and Association Cortex
Neural Circuits
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Association Areas of the Cortex
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Sequence Networks of Rotating Machines
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Associative Learning
Classical conditioning, also known...

