Related Experiment Video
Updated: Jun 26, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
When knowing can replace seeing in audiovisual integration of actions
Karin Petrini1, Melanie Russell, Frank Pollick
1Department of Psychology, University of Glasgow, 58 Hillhead Street, Glasgow, G12 8QB Scotland, United Kingdom. karin@psy.gla.ac.uk
Cognition
|January 6, 2009
Summary
Expert drummers can predict action consequences, improving multisensory integration even with missing visual cues. Practice enables internal models to fill sensory gaps, enhancing audiovisual synchrony perception.
Area of Science:
- Cognitive Neuroscience
- Auditory Perception
- Motor Learning
Background:
- Predicting action outcomes is crucial for navigating the physical and social world.
- Multisensory integration relies on combining information from different senses, but can be challenged by missing sensory data.
Purpose of the Study:
- To investigate how the ability to predict complex gesture consequences influences audiovisual integration when visual information is incomplete.
- To explore the role of expertise (drummers vs. novices) in adapting multisensory perception based on learned action models.
Main Methods:
- Participants (drummers and novices) judged audiovisual synchrony using drumming point-light displays.
- Visual information was manipulated to either include or exclude the drumstick-drumhead impact point.
- Audiovisual synchrony judgments were compared across conditions and expertise levels.
Main Results:
- Novices failed to detect asynchrony with only arm movement cues, unlike drummers.
- Drummers perceived optimal audiovisual alignment differently based on visual information: sight leading with impact, sound leading/synchronous without.
- Expertise-driven predictive models alter how sensory information is weighted and integrated.
Conclusions:
- Humans can develop internal action models through practice, enabling the replacement of missing sensory information.
- These acquired internal models significantly influence multisensory signal integration, particularly in dynamic, action-related contexts.
- Predictive processing based on learned action consequences enhances audiovisual synchrony perception in experts.
Related Concept Videos
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:13Nonconscious Mimicry
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
01:12Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...