Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Apr 28, 2026

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.5K

Self-Learning Multimodal Emotion Recognition Based on Multi-Scale Dilated Attention.

Xiuli Du1,2, Luyao Zhu1,2

  • 1School of Information Engineering, Dalian University, Dalian 116622, China.

Brain Sciences
|April 27, 2026
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Labeling Emotion01:20

Labeling Emotion

1.0K
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
1.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Methyl thiobutyrate: A microbial volatile compound with dual modes-of-action against root-knot nematodes.

Pest management science·2026
Same author

[Endogenous neddylation in B cells regulates immune responses in mice].

Zhejiang da xue xue bao. Yi xue ban = Journal of Zhejiang University. Medical sciences·2026
Same author

[<i>Qingre Lidan Jiedu</i> Recipe improves high copper load-induced cognitive dysfunction in rats by regulating mitophagy].

Nan fang yi ke da xue xue bao = Journal of Southern Medical University·2025
Same author

The comet assay: A contemporary approach for detecting genomic instability.

DNA repair·2025
Same author

The adaptive dynamic programming signal control system for person in a connected vehicle environment.

Scientific reports·2025
Same author

Mathematical derivation and mechanism analysis of beta oscillations in a cortex-pallidum model.

Cognitive neurodynamics·2024
Same journal

Anterior Cingulate Cortex Mediates State-Dependent Prioritization of Distressed Conspecifics.

Brain sciences·2026
Same journal

Hemispherotomy for Pediatric Post-Traumatic Epilepsy.

Brain sciences·2026
Same journal

When Robots Learn: Artificial Intelligence and the Next Human-Centered Era of Neurorehabilitation.

Brain sciences·2026
Same journal

The Association Between Changes in White Matter Microstructure and Cognitive Function in Older Adults with Mild Cognitive Impairment.

Brain sciences·2026
Same journal

Beyond Ventricular Enlargement: Multimodal MRI Assessment Improves Surgical Decision-Making in Normal Pressure Hydrocephalus.

Brain sciences·2026
Same journal

The Effects of Personalized Observation, Execution, and Mental Imagery (POEM) Therapy in Logopenic Primary Progressive Aphasia: A Telepractice-Based Single-Case Study.

Brain sciences·2026
See all related articles

This study introduces a multimodal framework integrating electroencephalogram (EEG) and facial expressions for improved emotion recognition. The model achieves high accuracy by adaptively fusing data from both modalities.

Area of Science:

  • Affective computing
  • Multimodal machine learning
  • Biomedical signal processing

Background:

  • Emotion recognition is challenging due to the complex interplay of psychological and physiological factors.
  • Single-modality models often lack robustness in emotion detection.
  • Integrating diverse data sources like EEG and facial expressions can enhance recognition accuracy.

Purpose of the Study:

  • To develop a robust multimodal emotion recognition framework.
  • To improve performance by integrating electroencephalogram (EEG) signals and facial expressions.
  • To enhance the adaptive fusion of multimodal data for accurate emotion analysis.

Main Methods:

  • A Multi-Scale Dilated Attention Convolution (MSDAC) network was used for facial expression analysis.
Keywords:
EEGaction unitsdecision-level fusiondifferential entropyemotion recognitionfacial expressionsmulti-scale dilated convolutionmultimodal

Related Experiment Videos

Last Updated: Apr 28, 2026

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.5K
  • EEG signals were processed into multidimensional time-frequency-spatial representations.
  • A self-learning decision-level fusion strategy adaptively combined information from both modalities.

    • Main Results:

    • The facial analysis branch achieved high accuracies across multiple datasets (e.g., 99.69% on CK+).
    • The multimodal model demonstrated strong performance on the DEAP dataset, reaching 98.66% for valence and 97.49% for arousal.
    • The proposed framework significantly improved emotion recognition capabilities.

    Conclusions:

    • The multimodal framework effectively integrates EEG and facial expression data.
    • Improved facial feature extraction and adaptive fusion enhance emotion recognition robustness.
    • Combining EEG and facial information offers a promising approach for comprehensive emotion analysis.