Related Experiment Video
Updated: Feb 6, 2026

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers
Published on: January 18, 2020
Auditory spatial attention is encoded in a retinotopic reference frame across eye-movements
Martijn Jan Schut1, Nathan Van der Stoep1, Stefan Van der Stigchel1
1Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
Abstract:
The retinal location of visual information changes each time we move our eyes. Although it is now known that visual information is remapped in retinotopic coordinates across eye-movements (saccades), it is currently unclear how head-centered auditory information is remapped across saccades. Keeping track of the location of a sound source in retinotopic coordinates requires a rapid multi-modal reference frame transformation when making saccades. To reveal this reference frame transformation, we designed an experiment where participants attended an auditory or visual cue and executed a saccade. After the saccade had landed, an auditory or visual target could be presented either at the prior retinotopic location or at an uncued location. We observed that both auditory and visual targets presented at prior retinotopic locations were reacted to faster than targets at other locations. In a second experiment, we observed that spatial attention pointers obtained via audition are available in retinotopic coordinates immediately after an eye-movement is made. In a third experiment, we found evidence for an asymmetric cross-modal facilitation of information that is presented at the retinotopic location. In line with prior single cell recording studies, this study provides the first behavioral evidence for immediate auditory and cross-modal transsaccadic updating of spatial attention. These results indicate that our brain has efficient solutions for solving the challenges in localizing sensory input that arise in a dynamic context.
Related Concept Videos
Inertial Frames of Reference
Non-inertial Frames of Reference
Framing Effects
Frames
Frames are versatile and widely used in various applications such as structural supports for beams and columns, automobile chassis construction, and in the construction...
Frames: Problem Solving II
Frames: Problem Solving I

