Related Experiment Video
Updated: Jul 12, 2026
09:04
Uncovering Beat Deafness: Detecting Rhythm Disorders with Synchronized Finger Tapping and Perceptual Timing Tasks
Published on: March 16, 2015
Hearing gestures, seeing music: vision influences perceived tone duration
Michael Schutz1, Scott Lipscomb
1School of Music, Northwestern University, Evanston, IL 60208, USA. schutz@virginia.edu
Perception
|August 28, 2007
Summary
Musicians use visual cues to influence perceived note duration. Longer gestures, even without longer sounds, create the impression of longer notes by integrating sensory information.
Area of Science:
- Cognitive Psychology
- Neuroscience
- Music Perception
Background:
- Auditory information typically dominates temporal judgments.
- Previous research suggests audition is primary in duration perception tasks.
Purpose of the Study:
- To investigate the role of visual cues in perceived musical note duration.
- To examine cross-modal integration in auditory-visual temporal tasks.
Main Methods:
- Separated auditory and visual components of percussion performances (long/short notes).
- Created audio-visual stimuli with mismatched sensory information.
- Participants rated note duration based solely on auditory input.
Main Results:
- Perceived note duration was influenced by visual cues (gestures), not auditory components alone.
- Longer visual gestures led to perceptions of longer notes, despite identical auditory stimuli.
Conclusions:
- Visual information significantly impacts perceived musical note duration.
- Cross-modal integration, particularly visual influence on auditory perception, challenges traditional models of temporal judgment.
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:25Factors Affecting Perception
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
01:13The Cochlea
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.