Related Experiment Video
Updated: Nov 1, 2025

Automated Midline Shift and Intracranial Pressure Estimation based on Brain CT Images
Published on: April 13, 2013
Estimation of in-scanner head pose changes during structural MRI using a convolutional neural network trained on eye
Heath R Pardoe1, Samantha P Martin1, Yijun Zhao2
1Comprehensive Epilepsy Center, Department of Neurology, NYU Grossman School of Medicine, New York, USA.
This study introduces a new way to track head movement during brain scans using existing eye-tracking cameras. By training a computer model to watch eye videos, researchers can accurately estimate how much a person moved their head. This information helps correct errors in brain measurements, making studies of brain health and disease more reliable.
Area of Science:
- Neuroimaging methodology and structural MRI analysis
- Computational neuroscience involving convolutional neural network applications
Background:
In-scanner head motion remains a significant obstacle for obtaining high-quality neuroimaging data. This instability introduces systematic errors in cortical thickness and volume measurements derived from structural scans. Few accessible techniques currently exist to monitor these movements during the acquisition process. That uncertainty drove the development of new tracking strategies. Prior research has shown that motion artifacts compromise the validity of brain morphometry. No prior work had resolved the challenge of using existing hardware for this purpose. This gap motivated the exploration of eye-tracking video as a potential source for motion data. The current investigation builds upon these observations to improve data integrity in clinical settings.
Purpose Of The Study:
The study aims to develop a predictive model that estimates head pose changes during structural MRI. In-scanner motion frequently degrades image quality and biases volumetric brain measurements. Current methods for tracking these movements are often limited or unavailable in standard clinical practice. This uncertainty drove the researchers to leverage existing eye-tracker video for motion monitoring. The investigators sought to create a tool that functions independently of specific imaging parameters. They also intended to avoid the use of external markers attached to the patient. By correlating pose estimates with morphometric data, the team explored the impact of motion on brain imaging results. This work addresses the need for improved motion correction strategies in neuroimaging research.
Main Methods:
The research team recruited twenty-one healthy volunteers to participate in the study. Participants performed prompted, stereotyped head movements while undergoing an EPI-BOLD sequence. Simultaneous recordings of eye-tracker video were collected during these sessions. The investigators also obtained T1-weighted whole-brain images for both motion-free and motion-affected conditions. Image coregistration provided the ground truth for head pose changes throughout the scanning duration. This information trained the predictive model to map visual features to specific head orientations. The authors evaluated the model using a hold-out dataset to ensure robust performance. Finally, they correlated these pose estimates with cortical thickness and subcortical volume metrics.
Main Results:
The predictive model demonstrated a significant correlation between video-based estimates and ground truth head pose changes. Increased head motion generally led to a brain-wide reduction in cortical thickness measurements. Some isolated brain regions displayed increased cortical thickness estimates despite the presence of motion. Subcortical volumes were consistently reduced in scans affected by participant movement. These findings confirm the negative impact of motion on standard morphometric outputs. The model successfully operated without the need for physical markers on the patient. This performance was achieved across diverse acquisition parameters, highlighting the flexibility of the approach. The results support the use of this tool for correcting motion-related biases in neuroimaging data.
Conclusions:
The researchers propose that their predictive model effectively estimates head pose changes using eye-tracking video. This approach functions independently of specific image acquisition parameters. It requires no physical markers attached to the participant, which enhances its utility in clinical environments. The authors suggest this method improves the neurobiological validity of structural imaging studies. Their findings indicate that motion-affected scans often show reduced cortical thickness and subcortical volumes. The team notes that these pose estimates serve as valuable covariates for future morphometric analyses. This synthesis implies that existing hardware can mitigate common motion-related biases. The study provides a practical tool for researchers working in brain development and disease fields.
Frequently Asked Questions
The researchers propose a convolutional neural network that analyzes eye-tracker video to predict head pose. This model correlates these video-based estimates with ground truth data from EPI-BOLD imaging, allowing for the quantification of motion during structural MRI scans.
The team utilizes an in-scanner eye tracker, which is standard equipment in many neuroimaging suites. This tool captures video data that the predictive model processes to infer head orientation without requiring additional external markers or sensors.
The authors explain that image coregistration of EPI-BOLD sequences is necessary to establish ground truth head pose changes. This technical step provides the training data required for the deep learning model to learn the relationship between eye movement and head position.
The researchers use video data as the input for their deep learning model. This data type allows the system to learn spatial features associated with head rotation, which are then used to estimate pose changes during subsequent structural scans.
The study measures the coefficient of determination (R2) to quantify model performance. Furthermore, the authors assess the relationship between video-based pose estimates and vertex-wise cortical thickness, as well as subcortical volume estimates, to validate the technique.
The authors claim that incorporating these pose estimates as covariates in morphometric analyses improves the neurobiological validity of imaging studies. They propose this method is well-suited for both research and clinical environments due to its independence from acquisition parameters.

