Related Experiment Video
Updated: Apr 25, 2026
Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
Published on: May 7, 2019
FaceTrack-AOI: An AI-driven tool for automated dynamic AOI placement and eye movement analysis in face perception
Xiaomei Zhou1, Guowei Chen2, Jinbiao Ning3
1Face Perception and Development Laboratory, School of Psychology, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, Guangdong, China. xzhou@szu.edu.cn.
Abstract:
Face perception is fundamental to human social interaction, relying on the dynamic allocation of visual attention to facial features across natural variations in poses, expressions, lighting and context-critical factors for real-world face perception. While eye-tracking studies have advanced our understanding of this process, analyzing gaze data in naturalistic settings presents challenges due to the labor-intensive and often subjective process of manually defining areas of interest (AOI) in dynamic stimuli. We introduce FaceTrack-AOI, an open-source, artificial intelligence (AI)-driven tool that automates dynamic AOI construction using robust 68-point facial landmark detection. Featuring a user-friendly graphical interface, the tool allows researchers to define and export eye movement metrics without programming expertise. It supports both rectangular and polygon-based AOIs, with customizable buffers, blank zones, and hierarchical configurations, accommodating diverse theoretical and methodological needs. Validation on multi-ethnic naturalistic video frames, images from a standardized face dataset (Chinese Face and Body Dataset [CFBD]), and benchmarks against a published study revealed strong agreement with expert-defined manual AOIs, achieving a mean spatial overlap of 95.73%. A proof-of-concept validation confirmed high fixation capture: over 98.8% of dwell time was correctly directed toward key AOIs. In two experiments with infants (6-18 months) and adults viewing 28,800 dynamic video frames, and children (2-8 years), both neurotypical and with autism spectrum disorder (ASD), viewing 80 static faces, FaceTrack-AOI demonstrated enhanced sensitivity in detecting developmental and group differences in naturalistic face recognition. By integrating AI-powered tracking with an intuitive interface, FaceTrack-AOI streamlines gaze analysis for dynamic facial stimuli, offering researchers an efficient and scalable solution to advance face perception research in ecologically valid contexts.
