Eye Tracking Insights Into Movement Preparation and Execution Under Nonstandard Visual Movement Feedback

For eye-hand coordination, predictions of sensory movement consequences may already be issued, and adjusted, during action preparation. In this pre-registered study, we combined a delayed-movement paradigm with a virtual reality-based eye-hand tracking task to investigate the oculomotor correlates of planning and executing coordinated eye-hand movements under standard versus nonstandard visual hand movement feedback. We measured pupil dilation and gaze-hand tracking during action preparation and subsequent task execution, where visual movement feedback violated or matched cued expectations: Participants prepared and, after a delay period, executed hand movements. Their movements were reflected by congruent or incongruent (inverted) movements of a glove-controlled virtual hand model, which they had to follow with their gaze. In the preceding delay period, visual cues could specify the to-be-executed movement (or leave it unspecified), and the visuomotor mapping (congruent or incongruent, 75% cue validity). We found that during the delay, pupil diameter increased more strongly when the movement was pre-cued (compared to left unspecified), and when nonstandard compared with standard visual movement feedback was expected. During execution, gaze-hand tracking performance decreased under nonstandard mappings, but significantly less so when the to-be-executed movement was pre-cued. Expectation violation trials produced a significantly stronger pupil dilation, particularly when congruent (standard) visuomotor expectations were violated, but also when incongruent mappings were cued but congruent ones observed. Furthermore, expectation violation impaired tracking performance; again, more strongly when congruent visuomotor expectations were violated. Our results indicate that oculomotor responses can reflect processes related to motor planning and flexible forward prediction of sensory action consequences ahead of execution, that is, increased mental effort and expectations of sensory conflict. Moreover, our results suggest that specific expectations about visuomotor (in)congruency affect eye-hand coordination and pupillary responses during subsequent execution of the planned action.