Related Experiment Video
Updated: Jan 22, 2026

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Fixating the eyes of a speaker provides sufficient visual information to modulate early auditory processing
Elina Kaplan1, Alexandra Jesse1
1Department of Psychological and Brain Sciences, University of Massachusetts, 135 Hicks Way, Amherst, MA, 01003, USA.
Abstract:
In face-to-face conversations, when listeners process and combine information obtained from hearing and seeing a speaker, they mostly look at the eyes rather than at the more informative mouth region. Measuring event-related potentials, we tested whether fixating the speaker's eyes is sufficient for gathering enough visual speech information to modulate early auditory processing, or whether covert attention to the speaker's mouth is needed. Results showed that when listeners fixated the eye region of the speaker, the amplitudes of the auditory evoked N1 and P2 were reduced when listeners heard and saw the speaker than when they only heard her. These cross-modal interactions also occurred when, in addition, attention was restricted to the speaker's eye region. Fixating the speaker's eyes thus provides listeners with sufficient visual information to facilitate early auditory processing. The spread of covert attention to the mouth area is not needed to observe audiovisual interactions.
Related Concept Videos
The Auditory Ossicles
The aptly named stapes look very much like a stirrup. The three ossicles are unique to mammals, and each plays a role in...
Fixation and Sectioning
The simplest type of preparation is the wet mount, in which the specimen is placed in a drop of liquid on the slide. A liquid specimen can be directly deposited on the slide using a dropper. Solid specimens, such as skin scraping, can be placed on the slide before adding a drop of liquid to prepare the wet mount. Sometimes the liquid is simply water, but stains are often added...
Auditory Pathway
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
Auditory Perception
Carbon-dioxide Fixation
Muscles of the Eye
Extraocular Muscles
The six extraocular muscles surround the eyeball and control its movements. They are responsible for a wide range of eye motions, including looking up, down, left, right, and...

