Related Experiment Video
Updated: Jan 4, 2026

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans
Published on: March 15, 2019
Detecting discomfort in infants through facial expressions
Yue Sun1, Caifeng Shan2,3, Tao Tan1
1Eindhoven University of Technology, Eindhoven, 5612 WH, The Netherlands.
Insights
Detecting infant discomfort using deep convolutional neural networks (CNNs) analyzing facial expressions significantly improves accuracy. This AI-driven approach offers potential for continuous pain monitoring in clinical settings.
Area of Science:
- Medical technology
- Artificial intelligence
- Infant health
Background:
- Early detection of infant discomfort is crucial to prevent adverse outcomes like impaired brain development.
- Untreated discomfort can lead to long-term issues in neuroendocrine and immune system responses.
- Current methods for assessing infant distress may be limited.
Purpose of the Study:
- To develop and evaluate a deep convolutional neural network (CNN) system for detecting infant discomfort.
- To analyze infant facial expressions for objective discomfort assessment.
- To improve the accuracy and efficiency of infant pain monitoring.
Main Methods:
- Utilized a dataset of 55 infant facial expression videos.
- Employed a pre-trained CNN model, fine-tuned with a public facial expression dataset and infant-specific data.
- Implemented a two-fold cross-validation strategy for performance evaluation.
Main Results:
- Achieved an Area Under the Curve (AUC) of 0.96 with the pre-trained and fine-tuned CNN model.
- Demonstrated superior performance compared to models without pre-training (AUC = 0.77) and methods using handcrafted features.
- Further improved AUC to 0.98 by fusing individual frame results.
Conclusions:
- The proposed CNN-based system shows high accuracy in detecting infant discomfort from facial expressions.
- This technology holds significant potential for continuous and objective discomfort and pain monitoring in clinical environments.
- Facial expression analysis via deep learning offers a promising avenue for improving infant care and outcomes.
Objective:
Detecting discomfort status of infants is particularly clinically relevant. Late treatment of discomfort infants can lead to adverse problems such as abnormal brain development, central nervous system damage and changes in responsiveness of the neuroendocrine and immune systems to stress at maturity. In this study, we exploit deep convolutional neural network (CNN) algorithms to address the problem of discomfort detection for infants by analyzing their facial expressions.
Approach:
A dataset of 55 videos about facial expressions, recorded from 24 infants, is used in our study. Given the limited available data for training, we employ a pre-trained CNN model, which is followed by fine-tuning the networks using a public dataset with labeled facial expressions (the shoulder-pain dataset). The CNNs are further refined with our data of infants.
Main Results:
Using a two-fold cross-validation, we achieve an area under the curve (AUC) value of 0.96, which is substantially higher than the results without any pre-training steps (AUC = 0.77). Our method also achieves better results than the existing method based on handcrafted features. By fusing individual frame results, the AUC is further improved from 0.96 to 0.98.
Significance:
The proposed system has great potential for continuous discomfort and pain monitoring in clinical practice.
More Related Videos
Related Concept Videos
Facial Feedback Hypothesis
Socioemotional Development during Infancy
Primary Temperament Types
Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
Piaget's Stage 1 of Cognitive Development
Exploration...
Muscles for Facial Expressions
Therapeutic Communication
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...

