Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Muscles for Facial Expressions01:14

Muscles for Facial Expressions

5.9K
The craniofacial muscles are a collection of approximately 20 thin skeletal muscles situated beneath the skin of the face and scalp. These muscles, primarily responsible for the vast array of human facial expressions, originate from the bones or fibrous structures of the skull and extend outwards to connect with the skin. While most skeletal muscles in the body are enveloped in thick fascia, facial muscles generally have a more delicate fascial covering, with the buccinator muscle being a...
5.9K
Association Areas of the Cortex01:21

Association Areas of the Cortex

10.7K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
10.7K
Prosopagnosia01:24

Prosopagnosia

1.2K
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
1.2K
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

878
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
878

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Lightweight dense video captioning with cross-modal attention and knowledge-enhanced unbiased scene graph.

Complex & intelligent systems·2023
Same author

MIRN: A multi-interest retrieval network with sequence-to-interest EM routing.

PloS one·2023
Same author

Visceral fat dysfunction is positively associated with hypogonadism in Chinese men.

Scientific reports·2016
Same author

Fingerprint Analysis of Desmodium Triquetrum L. Based on Ultra Performance Liquid Chromatography with Photodiode Array Detector Combined with Chemometrics Methods.

Journal of chromatographic science·2016
Same author

Neck circumference as an independent indicator to non-alcoholic fatty liver disease in non-obese men.

Nutrition & metabolism·2016
Same author

Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach.

Implementation science : IS·2015

Related Experiment Video

Updated: Apr 11, 2026

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques
11:34

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques

Published on: December 3, 2013

15.6K

VT-3DCapsNet: Visual tempos 3D-Capsule network for video-based facial expression recognition.

Zhuan Li1, Jin Liu1, Hengyang Wang1

  • 1College of Information Engineering, Shanghai Maritime University, Shanghai, China.

Plos One
|August 23, 2024
PubMed
Summary
This summary is machine-generated.

This study introduces a novel visual tempos 3D-CapsNet (VT-3DCapsNet) framework for improved facial expression recognition (FER). The model enhances feature representation and considers visual tempos for more accurate emotion detection.

More Related Videos

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.0K
Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.4K

Related Experiment Videos

Last Updated: Apr 11, 2026

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques
11:34

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques

Published on: December 3, 2013

15.6K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.0K
Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.4K

Area of Science:

  • Computer Vision
  • Deep Learning
  • Affective Computing

Background:

  • Traditional Convolutional Neural Networks (CNNs) struggle with facial expression recognition (FER) due to ignoring spatial relationships of facial features under real-world variations like rotation and occlusion.
  • Existing methods often fail to account for subtle differences in visual tempos, leading to lower accuracy for similar facial expressions.

Purpose of the Study:

  • To propose a novel visual tempos 3D-CapsNet (VT-3DCapsNet) framework to address limitations in current FER methods.
  • To enhance feature representation by integrating an improved 3D-ResNet with an AU-perceived attention module within a capsule network architecture.
  • To incorporate temporal dynamics using a Temporal Pyramid Network (TPN)-based expression recognition module (TPN-ERM) to model visual tempos.

Main Methods:

  • Developed an improved 3D-ResNet integrated with an AU-perceived attention module for enhanced feature representation in the capsule network.
  • Introduced a Temporal Pyramid Network-based Expression Recognition Module (TPN-ERM) to capture high-level facial motion features and model visual tempos.
  • Evaluated the VT-3DCapsNet framework on the extended Cohn-Kanada (CK+) and Acted Facial Expression in the Wild (AFEW) databases.

Main Results:

  • The proposed VT-3DCapsNet framework demonstrated enhanced ability to extract hierarchical spatiotemporal features and latent facial information.
  • The integration of TPN-ERM effectively modeled differences in visual tempos, improving recognition accuracy for similar expressions.
  • Experimental results showed competitive performance compared to existing state-of-the-art FER methods on benchmark datasets.

Conclusions:

  • The VT-3DCapsNet framework offers a significant advancement in facial expression recognition by effectively handling spatial relationships and temporal dynamics.
  • The proposed architecture successfully integrates deep spatiotemporal feature extraction with visual tempo modeling for robust emotion recognition.
  • This approach provides a promising direction for more accurate and reliable FER systems in complex real-world scenarios.