Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

293
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
293
Physiology of Emotion01:20

Physiology of Emotion

1.7K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.7K
Labeling Emotion01:20

Labeling Emotion

326
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
326
Automatic Processing and Automatic Social Behavior01:28

Automatic Processing and Automatic Social Behavior

20
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
20
Cognitive Theories: Schachter-Singer Theory of Emotion01:20

Cognitive Theories: Schachter-Singer Theory of Emotion

722
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
722
Emotional Expression01:26

Emotional Expression

493
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
493

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Temporal Changes in Left Ventricular Strain in Typical and Atypical Left Bundle Branch Block Patients: A Follow-up Study.

Pacing and clinical electrophysiology : PACE·2026
Same author

MultiRetNet: A Lightweight Explainable AI Approach to Diabetic Retinopathy Grading and DME Detection Using Fundus-OCT Fusion.

Journal of imaging·2026
Same author

A novel and accurate EEG emotion classification model based on multiple attention local binary patterns.

BMC medicine·2026
Same author

Different pattern: a new EEG-based method for mental performance detection.

BMC medical informatics and decision making·2026
Same author

A multi-level attention CNN-transformer based framework for the detection of brain tumor using regional dual-score explainability.

Scientific reports·2026
Same author

Impact of Pollution on Mental Health: A Systematic Review of Associations, Methodological Challenges, and Future Directions.

Health science reports·2026

Related Experiment Video

Updated: Oct 5, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.3K

Automated emotion recognition: Current trends and future perspectives.

M Maithri1, U Raghavendra2, Anjan Gudigar2

  • 1Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India.

Computer Methods and Programs in Biomedicine
|January 30, 2022
PubMed
Summary
This summary is machine-generated.

This review examines how computers are taught to identify human feelings using brain waves, facial expressions, and voice patterns. By analyzing recent studies, the authors highlight how deep learning has improved the accuracy of these systems. While current technology works well in stable settings, the authors note that making these tools reliable in everyday, unpredictable environments remains a major challenge.

Keywords:
CADElectroencephalogram (EEG)FacialHuman emotionsMachine learningVoicedeep learningmultimodal analysisbiometric signalsaffective state detection

Frequently Asked Questions

More Related Videos

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.6K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.2K

Related Experiment Videos

Last Updated: Oct 5, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.3K
Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation
07:12

Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation

Published on: August 26, 2016

9.6K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.2K

Area of Science:

  • Biomedical engineering and automated emotion recognition systems
  • Computational neuroscience and signal processing

Background:

No prior work has fully synthesized the rapid evolution of computational tools for detecting affective states in diverse settings. It was already known that internal feelings significantly influence individual behavioral patterns across many daily scenarios. Prior research has shown that digital diagnostic aids have become increasingly prevalent in sectors like medical monitoring and digital education. That uncertainty drove the need to evaluate how various physiological and behavioral inputs are processed by modern algorithms. This gap motivated a comprehensive look at how different signal types are integrated to interpret human states. Prior studies have often focused on isolated modalities rather than comparing the efficacy of combined approaches. Researchers have struggled to standardize performance metrics across the vast array of available diagnostic frameworks. This review addresses the current landscape by examining how these diverse technological approaches have matured over the last half-decade.

Purpose Of The Study:

The aim of this review is to provide a comprehensive insight into the various methods employed for automated detection of human feelings. The researchers sought to evaluate how different signal types are processed by modern computational tools. This investigation addresses the growing need to understand the efficacy of current diagnostic frameworks in diverse settings. The authors focused on identifying the most effective techniques developed over the five-year period ending in 2021. By analyzing a wide range of state-of-the-art papers, the study clarifies the role of deep learning in this domain. The motivation stems from the increasing application of these tools in healthcare and digital education. The authors intended to highlight the strengths and limitations of existing models to guide future development. This work serves as a critical assessment of how far the field has progressed in achieving accurate, automated interpretation of human states.

Main Methods:

Review approach involved a systematic examination of literature published between 2016 and 2021. The authors screened state-of-the-art publications to identify trends in computational modeling for affective state detection. Each selected study underwent a rigorous evaluation based on the specific input signals utilized for analysis. The investigators categorized papers by the type of classifier implemented to process these signals. Performance metrics were extracted to compare the efficacy of different algorithmic frameworks. The team focused on how researchers integrated electroencephalogram, vocal, and visual data streams. This synthesis prioritized studies that employed advanced neural network architectures. The final selection process ensured a representative overview of current technological capabilities in the field.

Main Results:

Key findings from the literature reveal a substantial increase in the adoption of deep learning techniques for processing affective data. The authors report that these sophisticated models consistently yield high performance when applied to electroencephalogram, speech, and facial expression inputs. The data indicates that multimodal integration significantly enhances the reliability of these systems compared to single-modality approaches. Most systems demonstrated robust capabilities when operating within strictly controlled laboratory environments. The review highlights that deep learning has become the standard for achieving high accuracy in modern diagnostic tools. However, the authors note that performance often declines when these models are tested in uncontrolled, real-world conditions. The analysis confirms that current research is heavily skewed toward laboratory-based validation. The findings suggest that while accuracy is high, the transition to naturalistic settings remains a persistent challenge for the field.

Conclusions:

The authors suggest that deep learning architectures have become the dominant approach for achieving high accuracy in affective computing. Synthesis and implications indicate that these models perform reliably when tested under strictly regulated laboratory conditions. The researchers propose that future efforts must prioritize maintaining this precision outside of artificial settings. The evidence highlights a clear performance gap between controlled experiments and real-world, unpredictable scenarios. The authors emphasize that integrating multiple data streams remains a promising strategy for enhancing system robustness. This review implies that current progress relies heavily on the quality and diversity of training datasets. The authors conclude that transitioning to uncontrolled environments is the next major hurdle for the field. The findings underscore the necessity of developing adaptive algorithms that can handle noise and variability in naturalistic data.

The researchers propose that deep learning architectures are the primary mechanism for improving accuracy. These systems analyze inputs like electroencephalogram readings, vocal patterns, and visual facial cues to categorize affective states, outperforming traditional machine learning models in controlled settings.

The authors evaluate multimodal frameworks, which combine different data sources to enhance detection. These systems integrate physiological signals, such as brain activity, with behavioral markers like speech and facial movements to create a more comprehensive profile of a person's state.

The authors state that high-quality, labeled data is a technical necessity for training deep learning models. Without large, diverse datasets, these systems cannot effectively learn the complex patterns required to distinguish between various human feelings across different populations.

The researchers highlight that facial expression data plays a significant role in multimodal systems. By capturing visual changes, these models complement auditory and brain-based inputs, allowing for a more nuanced interpretation of human behavior than any single modality could provide alone.

The authors measure performance by comparing the accuracy of models developed between 2016 and 2021. They observe that while deep learning systems achieve high success rates in laboratory environments, their effectiveness often drops when applied to uncontrolled, real-world settings.

The authors propose that future research should focus on achieving high performance in uncontrolled environments. They suggest that overcoming this limitation is essential for the practical deployment of emotion recognition tools in everyday life.