Related Experiment Video
Updated: Sep 28, 2025

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
Spatial shifts in swiping actions, the impact of "left" and "right" verbalizations
Raimey Olthuis1, John van der Kamp2, Koen Lemmink3
1Center for Human Movement Sciences, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands. r.a.olthuis@umcg.nl.
Abstract:
Movements are often modulated by the meaning of cue words. We explore the interaction between verbal and visual constraints during a movement by investigating if spoken words during movement execution bias late movement control of swiping actions on a tablet when vision of the target is removed during the movement. Verbalization trials required participants to vocalize the spatial directions 'LEFT', 'MIDDLE', or 'RIGHT' of the active target, relative to the other presented targets. A late influence of semantics emerged on movement execution in verbalized trials with action endpoints landing more in the direction of the spoken word than without verbalization. The emergence of the semantic effect as the movement progresses reflects the temporal unfolding of the visual and verbal constraints during the swiping action. Comparing our current results with a similar task using a variant verbalization, we also conclude that, larger semantic content effects are found with spatial direction than numerical magnitude verbalization.

