Related Experiment Video
Updated: May 25, 2025

10:41
Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
Published on: May 26, 2018
6.8K
[Dynamic continuous emotion recognition method based on electroencephalography and eye movement signals].
Yangmeng Zou1,2, Lilin Jie1,2, Mingxun Wang3
1Jiangxi Provincial Key Laboratory of Image Processing and Pattern Recognition, Nanchang Hangkong University, Nanchang 330063, P. R. China.
Summary
This study introduces a novel method for dynamic emotion recognition using electroencephalography (EEG) and eye movement. The approach accurately identifies emotion transitions in real-time, outperforming single-modality methods.
Area of Science:
- Neuroscience
- Affective Computing
- Signal Processing
Context:
- Current emotion recognition methods are limited to static environments.
- Dynamic emotion transitions in real-world scenarios are under-researched.
- Multimodal datasets for dynamic emotion recognition are scarce.
Purpose:
- To develop a dynamic continuous emotion recognition method using electroencephalography (EEG) and eye movement signals.
- To create a novel multimodal dataset capturing six emotion transition scenarios.
- To evaluate the efficacy of feature fusion and regression models for dynamic emotion recognition.
Summary:
- A new method combines EEG and eye movement data for dynamic emotion recognition.
- Frequency band features were extracted and fused using a cascade approach.
- Four regression models were employed to predict continuous valence and arousal levels.
- The proposed multimodal approach demonstrated superior accuracy in recognizing emotion transitions.
Impact:
- Establishes a new benchmark for dynamic continuous emotion recognition.
- Provides a valuable dataset for advancing research in affective computing.
- Offers a robust and accurate solution for real-world emotion-aware systems.
- Enhances understanding of neural and oculomotor correlates of dynamic emotional states.

