The emotional perception and cognitive processing during multimedia learning in students with depressive tendencies

Area of Science:

• Educational Psychology
• Human-Computer Interaction
• Cognitive Science

Background:

• The influence of pedagogical agents' emotions on learning is established for healthy students.
• Limited research exists on how pedagogical agents' emotions affect learners with depressive tendencies.

Purpose of the Study:

• To investigate the impact of pedagogical agents' visual and auditory emotional cues on emotional perception and cognitive processing in students with depressive tendencies.
• To explore the role of emotional congruency across channels in multimedia learning for this population.

Main Methods:

• Students with depressive tendencies were exposed to pedagogical agents displaying emotional cues via facial expressions and voice tones.
• Learners' emotional perception, social connection, cognitive load, and performance on transfer tests were assessed.

Main Results:

• Learners perceived negative facial expressions but not positive ones, aligning with Beck's cognitive theory of depression.
• Positive voice tones enhanced social connection, supporting positivity and emotional contagion theories.
• Congruent emotional cues (visual and auditory) increased germane cognitive load and improved transfer test performance, demonstrating the congruency effect.

Conclusions:

• Multimedia learning designers should leverage auditory emotional cues and channel congruency for students with depressive tendencies.
• Prioritizing auditory cues and emotional congruency can enhance emotional perception and cognitive processing in this demographic.