Related Experiment Video
Updated: Oct 8, 2025

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions
Published on: July 6, 2011
Combining fMRI and Eye-tracking for the Study of Social Cognition
Kristin Marie Rusch1,2,3
1Laboratory for Multimodal Neuroimaging, Department of Psychiatry and Psychotherapy, University of Marburg, Marburg, Germany.
Abstract:
The study of social cognition with functional magnetic resonance imaging (fMRI) affords the use of complex stimulus material. Visual attention to distinct aspects of these stimuli can result in the involvement of remarkably different neural systems. Usually, the influence of gaze on neural signal is either disregarded or dealt with by controlling gaze of participants through instructions or tasks. However, behavioral restrictions like this limit the study's ecological validity. Thus, it would be preferable if participants freely look at the stimuli while their gaze traces are measured. Yet several impediments hamper a combination of fMRI and eye-tracking. In our recent work on neural Theory of Mind processes in alexithymia, we propose a simple way of integrating dwell time on specific stimulus features into general linear models of fMRI data. By parametrically modeling fixations, we were able to distinguish neural processes asssociated with specific stimulus features looked at. Here, I discuss opportunities and obstacles of this approach in more detail. My goal is to motivate a wider use of parametric models - usually implemented in common fMRI software packages - to combine fMRI and eye-tracking data.
More Related Videos
05:32Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos
Published on: December 7, 2018
13:40Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking
Published on: December 16, 2010