Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Labeling Emotion01:20

Labeling Emotion

427
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
427
Cognitive Theories: Schachter-Singer Theory of Emotion01:20

Cognitive Theories: Schachter-Singer Theory of Emotion

924
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
924
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

370
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
370
Physiology of Emotion01:20

Physiology of Emotion

2.4K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
2.4K
Physiological Theories: James-Lange Theory of Emotion01:16

Physiological Theories: James-Lange Theory of Emotion

1.3K
The James-Lange theory of emotion, proposed by William James and Carl Lange in the late 19th century, asserts that emotions are the result of physiological reactions to external stimuli. Contrary to the traditional view, which suggests that emotions directly arise from the perception of stimuli, this theory proposes that emotions occur as a consequence of the body's responses to such stimuli. According to this framework, an emotional experience is a cognitive interpretation of physiological...
1.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Serotype Distribution and Antimicrobial Resistance of <i>Salmonella</i> in Korea Between 2018 and 2022.

Annals of laboratory medicine·2025
Same author

Federated Learning for Cardiovascular Disease Prediction: A Comparative Review of Biosignal- and EHR-Based Approaches.

Healthcare (Basel, Switzerland)·2025
Same author

DenseTextPVT: Pyramid Vision Transformer with Deep Multi-Scale Feature Refinement Network for Dense Text Detection.

Sensors (Basel, Switzerland)·2023
Same author

Robust Human Face Emotion Classification Using Triplet-Loss-Based Deep CNN Features and SVM.

Sensors (Basel, Switzerland)·2023
Same author

Survival Prediction Using Transformer-Based Categorical Feature Representation in the Treatment of Diffuse Large B-Cell Lymphoma.

Healthcare (Basel, Switzerland)·2023
Same author

A Review of Machine Learning and Deep Learning Approaches on Mental Health Diagnosis.

Healthcare (Basel, Switzerland)·2023

Related Experiment Video

Updated: Nov 10, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.7K

Context-Aware Emotion Recognition in the Wild Using Spatio-Temporal and Temporal-Pyramid Models.

Nhu-Tai Do1, Soo-Hyung Kim1, Hyung-Jeong Yang1

  • 1Department of Artificial Intelligence Convergence, Chonnam National University, 77 Yongbong-ro, Gwangju 500-757, Korea.

Sensors (Basel, Switzerland)
|April 3, 2021
PubMed
Summary

This study introduces a flexible system for video emotion recognition, improving accuracy by using face features with context and statistical information. It enhances long-term temporal analysis and multi-modal fusion for better emotion classification.

Keywords:
best selection ensemblefacial emotion recognitionspatiotemporaltemporal-pyramidvideo emotion recognition

More Related Videos

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.3K
Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome
08:31

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

14.1K

Related Experiment Videos

Last Updated: Nov 10, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.7K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.3K
Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome
08:31

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

14.1K

Area of Science:

  • Computer Vision
  • Artificial Intelligence
  • Human-Computer Interaction

Background:

  • Video emotion recognition faces challenges like occlusion, illumination, and complex temporal dynamics.
  • Existing multi-modal approaches struggle with long-term dependencies and integrating diverse information.
  • Effective emotion recognition is crucial for advancing human-computer interactions.

Purpose of the Study:

  • To develop a flexible, multi-modal system for robust video-based emotion recognition in real-world scenarios.
  • To enhance the exploitation of temporal information and contextual cues for accurate emotion classification.
  • To improve multi-modal fusion techniques for superior performance in recognizing seven basic emotions.

Main Methods:

  • A novel system employing face tracking and voting for persons of interest in videos.
  • Face feature extraction incorporating context-aware and statistical information.
  • Two distinct model architectures: a temporal-pyramid model and a spatiotemporal model (Conv2D+LSTM+3DCNN+Classify).
  • A best selection ensemble method for optimal multi-modal fusion.

Main Results:

  • The proposed system achieves high accuracy on the benchmark AFEW dataset.
  • The temporal-pyramid and spatiotemporal models effectively capture long-term temporal dependencies.
  • The best selection ensemble significantly improves the accuracy of multi-modal fusion for emotion classification.

Conclusions:

  • The developed system offers a flexible and accurate solution for video emotion recognition in the wild.
  • Context-aware face features and advanced temporal modeling are key to improved emotion recognition.
  • The best selection ensemble strategy enhances the integration of multi-modal information for robust performance.