Related Experiment Video
Updated: Feb 7, 2026
05:33
Experimental Paradigm for Measuring the Effect of Induced Emotion on Grammar Learning
Published on: January 29, 2020
6.5K
A deep learning approach to emotionally intelligent AI for improved learning outcomes
Xiaoyu Wu1,2, Tientien Lee3,4, Umesh Kumar Lilhore5
1Faculty of Social Sciences and Liberal Arts, UCSI University, No. 1, UCSI Heights, Jalan Puncak Menara Gading, Taman Connaught, 56000, Cheras, Wilayah Persekutuan Kuala Lumpur, Malaysia.
Scientific Reports
|February 5, 2026
Summary
This study introduces an emotion-aware deep learning framework for AI education, enhancing learner engagement and performance by integrating emotional intelligence. The multimodal system analyzes facial expressions, speech, and text for adaptive learning experiences.
Area of Science:
- Artificial Intelligence in Education
- Affective Computing
- Deep Learning
Background:
- Current AI education systems primarily focus on cognitive adaptation.
- Learner emotional states are often overlooked, impacting engagement and learning outcomes.
- There is a need for intelligent learning environments that incorporate emotional intelligence.
Purpose of the Study:
- To propose a multimodal, emotion-aware deep learning framework for intelligent learning environments.
- To integrate emotional intelligence into AI-driven educational systems.
- To improve learner engagement, emotional regulation, and task persistence.
Main Methods:
- Developed a multimodal deep learning framework analyzing facial expressions, speech, and text.
- Employed a graph-based fusion mechanism to model interdependencies between emotional modalities.
- Evaluated the framework using AffectNet and IEMOCAP benchmark emotion datasets.
Main Results:
- The emotion-aware framework significantly improved learner engagement, emotional regulation, and task persistence compared to cognition-focused systems.
- Achieved high emotion recognition performance, especially for positive and neutral states, with robust generalization.
- User studies indicated learners found the system more supportive and responsive due to emotional adaptability.
Conclusions:
- Multimodal emotional intelligence is crucial for developing empathetic and effective AI educational systems.
- Integrating emotional awareness enhances the adaptiveness and responsiveness of intelligent learning environments.
- Ethical considerations such as data privacy and responsible deployment are vital for emotion-aware educational technologies.
Related Concept Videos
01:14Avoidance Learning and Learned Helplessness
2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
01:27Associative Learning
1.3K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.3K
01:22Purposive Learning
512
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
512
01:12Observational Learning
1000
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1000
01:25Learning Disabilities
626
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
Dyslexia
Dyslexia is a...
626
01:18Introduction to Learning
1.2K
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
1.2K