Evaluating Ensemble Learning Methods for Multi-Modal Emotion Recognition Using Sensor Data Fusion

Eman M G Younis1, Someya Mohsen Zaki2, Eiman Kanjo3

  • 1Faculty of Computers and Information Minia University, Minia 61519, Egypt.

Summary

This study explores how to accurately detect human emotions using data from wearable sensors and environmental devices. By combining physiological signals and surrounding data, researchers developed a generic model that works across different individuals. The team tested various machine learning techniques to see which combination produced the most reliable predictions in real-world settings. They found that a specific stacking approach achieved the highest accuracy, outperforming other common methods. This work helps improve how computers understand and interact with human emotional states in daily life.

Frequently Asked Questions

Related Concept Videos

Labeling Emotion01:20

Labeling Emotion

Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
231
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
145
Cognitive Theories: Schachter-Singer Theory of Emotion01:20

Cognitive Theories: Schachter-Singer Theory of Emotion

Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
565
Physiology of Emotion01:20

Physiology of Emotion

The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.3K
Cognitive Theories: Lazarus Mediational Theory of Emotion01:17

Cognitive Theories: Lazarus Mediational Theory of Emotion

Richard Lazarus' cognitive mediational theory highlights the pivotal role of cognitive appraisal in shaping emotional responses. According to this theory, the evaluation of a stimulus — based on personal values, goals, beliefs, and expectations — mediates the emotional response. This appraisal process is immediate and often occurs unconsciously, influencing the intensity and nature of the resulting emotion.
Cognitive Appraisal and Emotional Response
Lazarus proposed that...
1.1K