Related Experiment Video
Updated: Jan 1, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Pupillometric decoding of high-level musical imagery
Olivia Kang1, Mahzarin R Banaji1
1Department of Psychology, Harvard University, 33 Kirkland St., Cambridge, MA 02138, United States.
Abstract:
Humans report imagining sound where no physical sound is present: we replay conversations, practice speeches, and "hear" music all within the confines of our minds. Research has identified neural substrates underlying auditory imagery; yet deciphering its explicit contents has been elusive. Here we present a novel pupillometric method for decoding what individuals hear "inside their heads". Independent of light, pupils dilate and constrict in response to noradrenergic activity. Hence, stimuli evoking unique and reliable patterns of attention and arousal even when imagined should concurrently produce identifiable patterns of pupil-size dynamics (PSDs). Participants listened to and then silently imagined music while eye-tracked. Using machine learning algorithms, we decoded the imagined songs within- and across-participants following classifier-training on PSDs collected during both imagination and perception. Echoing findings in vision, cross-domain decoding accuracy increased with imagery strength. These data suggest that light-independent PSDs are a neural signature sensitive enough to decode imagination.
More Related Videos
13:12Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
Published on: August 12, 2019
10:41Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
Published on: May 26, 2018
Related Concept Videos
Auditory Perception
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...