Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

229
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
229
Emotional Expression01:26

Emotional Expression

331
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
331
Labeling Emotion01:20

Labeling Emotion

214
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
214
Physiology of Emotion01:20

Physiology of Emotion

1.1K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.1K
Muscles for Facial Expressions01:14

Muscles for Facial Expressions

2.4K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
2.4K
Therapeutic Communication01:30

Therapeutic Communication

4.8K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
4.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

mmWave-RM: A Respiration Monitoring and Pattern Classification System Based on mmWave Radar.

Sensors (Basel, Switzerland)·2024
Same author

Wi-CHAR: A WiFi Sensing Approach with Focus on Both Scenes and Restricted Data.

Sensors (Basel, Switzerland)·2024
Same author

PGGait: Gait Recognition Based on Millimeter-Wave Radar Spatio-Temporal Sensing of Multidimensional Point Clouds.

Sensors (Basel, Switzerland)·2024
Same author

Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar.

Sensors (Basel, Switzerland)·2023
Same author

mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point Cloud.

Sensors (Basel, Switzerland)·2023
Same author

UltrasonicGS: A Highly Robust Gesture and Sign Language Recognition Method Based on Ultrasonic Signals.

Sensors (Basel, Switzerland)·2023

Related Experiment Video

Updated: Aug 15, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.0K

Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition.

Xiaochao Dang1, Zetong Chen1, Zhanjun Hao1

  • 1College of Computer Science & Engineering, Northwest Normal University, Lanzhou 730070, China.

Sensors (Basel, Switzerland)
|January 8, 2023
PubMed
Summary

This study introduces a novel deep learning model for emotion recognition, achieving high accuracy by combining millimeter-wave radar signals with facial expressions. The advanced method surpasses traditional algorithms in identifying emotions for improved mental and physical health insights.

Keywords:
convolutional neural networkemotion recognitionfrequency modulated continuous wavegated recurrent unitmultimodal

More Related Videos

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.5K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.1K

Related Experiment Videos

Last Updated: Aug 15, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.0K
Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.5K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.1K

Area of Science:

  • Neuroscience
  • Psychology
  • Medicine
  • Artificial Intelligence
  • Signal Processing

Background:

  • Emotions profoundly influence physical and mental health, making emotion recognition a critical research area.
  • Existing methods for emotion recognition often rely on visual cues or physiological signals independently.
  • Millimeter-wave (MMW) radar offers a non-invasive method to capture subtle physiological signals like heartbeat and respiration.

Purpose of the Study:

  • To develop and evaluate a novel deep learning model for accurate emotion recognition.
  • To integrate physiological data from MMW radar with facial expression analysis.
  • To compare the performance of the proposed model against traditional machine learning algorithms and single deep learning approaches.

Main Methods:

  • Raw signals from millimeter-wave radar were preprocessed to extract high-quality heartbeat and respiration data.
  • A hybrid deep learning architecture was designed, combining a convolutional neural network (CNN) for spatial feature extraction and a gated recurrent unit (GRU) neural network for temporal sequence modeling.
  • The model was trained and validated using a dataset that includes both MMW radar signals and human face expression images.

Main Results:

  • The proposed deep learning model achieved a person-dependent recognition accuracy of 84.5%.
  • In person-independent experiments, the model demonstrated a recognition accuracy of 74.25%.
  • Experimental results indicate that the integrated deep learning model significantly outperforms traditional machine learning algorithms and single deep learning models.

Conclusions:

  • The fusion of MMW radar-derived physiological signals and facial expressions via a CNN-GRU deep learning model offers a promising approach for robust emotion recognition.
  • This method provides a more comprehensive understanding of emotional states by leveraging multi-modal data.
  • The findings suggest potential applications in healthcare, human-computer interaction, and mental well-being monitoring.