Related Experiment Video
Updated: Aug 20, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
Adaptation of neuromagnetic N1 responses to phonetic stimuli by visual speech in humans
Iiro P Jääskeläinen1, Ville Ojanen, Jyrki Ahveninen
1Laboratory of Computational Engineering, Helsinki University of Technology, Espoo, P.O. Box 9203, Innopoli 2, Tekniikant. 14, FIN-02015 HUT Finland. iiro.jaaskelainen@hut.fi
Abstract:
The technique of 306-channel magnetoencephalogaphy (MEG) was used in eight healthy volunteers to test whether silent lip-reading modulates auditory-cortex processing of phonetic sounds. Auditory test stimuli (either Finnish vowel /ae/ or /ø/) were preceded by a 500 ms lag by either another auditory stimulus (/ae/, /ø/ or the second-formant midpoint between /ae/ and /ø/), or silent movie of a person articulating /ae/ or /ø/. Compared with N1 responses to auditory /ae/ and /ø/ when presented without a preceding stimulus, the amplitudes of left-hemisphere N1 responses to the test stimuli were significantly suppressed both when preceded by auditory and visual stimuli, this effect being significantly stronger with preceding auditory stimuli. This suggests that seeing articulatory gestures of a speaker influences auditory speech perception by modulating the responsiveness of auditory-cortex neurons.

