Related Experiment Video
Updated: Jan 1, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Pupillometric decoding of high-level musical imagery
Olivia Kang1, Mahzarin R Banaji1
1Department of Psychology, Harvard University, 33 Kirkland St., Cambridge, MA 02138, United States.
Researchers decoded imagined music using pupil size dynamics (PSDs). This novel pupillometry method reveals pupil size changes reflect auditory imagination, offering insights into mental sound experiences.
Area of Science:
- Cognitive Neuroscience
- Auditory Perception and Imagery
- Psychophysiology
Background:
- Humans frequently engage in auditory imagery, mentally hearing sounds like music or speech without external stimuli.
- While neural correlates of auditory imagery exist, decoding the specific content of these mental sounds has remained challenging.
Purpose of the Study:
- To introduce and validate a novel pupillometric method for decoding the content of auditory imagery.
- To investigate if pupil size dynamics (PSDs) can serve as a neural signature for imagined sounds.
Main Methods:
- Participants listened to music and then silently imagined it while their eye movements were tracked.
- Pupil size dynamics (PSDs) were recorded, independent of ambient light, linked to noradrenergic activity.
- Machine learning algorithms were employed to decode imagined songs from PSDs, trained on both perceived and imagined music.
Main Results:
- The study successfully decoded imagined songs using PSDs, both within and across participants.
- Decoding accuracy correlated positively with self-reported imagery strength, similar to findings in visual imagery.
- Identifiable patterns in pupil size dynamics were observed during auditory imagination.
Conclusions:
- Light-independent pupil size dynamics (PSDs) provide a sensitive neural signature for decoding auditory imagination.
- This pupillometric approach offers a new window into understanding the contents of mental auditory experiences.
More Related Videos
13:12Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
Published on: August 12, 2019
10:41Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
Published on: May 26, 2018
Related Concept Videos
Auditory Perception
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...