Related Experiment Video
Updated: May 17, 2026

07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
Task switching, modality compatibility, and the supra-modal function of eye movements.
Denise Nadine Stephan1, Iring Koch, Jessica Hendler
1Department of Psychology, RWTH Aachen University, Germany. stephan@psych.rwth-aachen.de
Experimental Psychology
|October 11, 2012
Summary
The modality compatibility effect, influencing dual-task performance, is weaker when oculomotor responses replace manual responses. This suggests oculomotor responses are less prone to interference in task switching.
Area of Science:
- Cognitive Psychology
- Human-Computer Interaction
- Neuroscience
Background:
- Prior studies indicate modality compatibility (e.g., visual-manual) enhances dual-task performance.
- The modality compatibility effect describes performance benefits from congruent stimulus-response pairings.
- Investigating alternative response modalities is crucial for understanding cognitive processing limitations.
Purpose of the Study:
- To examine the modality compatibility effect in a task-switching paradigm.
- To investigate the influence of different response modalities (manual, vocal, oculomotor) on this effect.
- To explore the underlying mechanisms of modality compatibility, particularly cross-talk in central processing.
Main Methods:
- A task-switching experiment was designed.
- Participants performed tasks involving different stimulus-response modality pairings.
- Oculomotor responses were included as a novel response modality alongside manual and vocal responses.
Main Results:
- A significant modality compatibility effect was observed, particularly in vocal-manual response groups.
- The effect was substantially reduced or abolished in the vocal-oculomotor response group.
- Switch costs differed significantly based on the combination of stimulus and response modalities.
Conclusions:
- The modality compatibility effect appears to be mediated by central processing cross-talk, especially with manual responses.
- Oculomotor responses may be less susceptible to this cross-talk due to their unique functional role in visual orientation.
- Response modality plays a critical role in modulating the modality compatibility effect in cognitive tasks.

