Related Experiment Video
Updated: Jul 9, 2026

A Method to Study Adaptation to Left-Right Reversed Audition
Published on: October 29, 2018
A behavioral and electrophysiological investigation of the effect of horizontal head viewing angle on audiovisual
Jeroen J Stekelenburg1, Martijn Baart1, Jean Vroomen1
1Department of Cognitive Neuropsychology, Tilburg University, Tilburg, the Netherlands.
Abstract:
We investigated how horizontal viewing angle of a speaking face influences audiovisual (AV) speech integration at the behavioral and neural level. In Experiment 1, seventeen participants identified consonant-vowel syllables (/faː/, /feː/, /foː/, /paː/, /peː/, /poː/, /taː/, /teː/, /toː/) presented in audiovisual, visual-only, and auditory-only conditions across four head orientations (frontal, oblique, profile, side-back at 0°, 45°, 90°, and 100°, respectively), in quiet and white-noise (-14 dB SNR) masking conditions. Audiovisual gain by lip read information (AV minus A-only accuracy) declined with increasing head rotations for speech-in-noise, but only for /p/, while accuracy in the visual-only condition followed a similar trend. Experiment 2 measured electrophysiology (EEG) in twenty-eight participants for four syllables (/faː/, /foː/, /paː/, /poː/) in quiet examining N1/P2 event-related potential (ERP) components for audiovisual, auditory-only, and visual-only stimulus presentations. Peak-amplitude and cluster-based analyses revealed that the well-documented N1 suppression by visual speech information (AV - V < A) was maximal at oblique (45°) head rotations, and significantly reduced at profile and side-back angles, whereas P2 suppression remained constant across all angles. N1 and P2 latencies were consistently shorter for AV - V than A-only conditions for all angles. These results demonstrate a dissociation between temporal (N1 amplitude suppression) and phonetic (P2 amplitude suppression) integrative mechanisms: temporal prediction degraded with profile/side-back head orientations, whereas audiovisual phonetic integration was not affected by the viewing angle of the head. Our findings indicate that head rotation reduces, but does not eliminate, audiovisual speech integration.
More Related Videos
Related Concept Videos
Sound Waves: Interference
Doppler Effect - II
Echo
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case, then the...
Equilibrium and Balance

