Related Experiment Video
Updated: May 28, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
Is cross-modal integration of emotional expressions independent of attentional resources?
J Vroomen1, J Driver, B de Gelder
1Tilburg University, Department of Psychology, P.O. Box 90153, 5000 LE, Tilburg, The Netherlands. j.vroomen@kub.nl
Abstract:
In this study, we examined whether integration of visual and auditory information about emotions requires limited attentional resources. Subjects judged whether a voice expressed happiness or fear, while trying to ignore a concurrently presented static facial expression. As an additional task, the subjects had to add two numbers together rapidly (Experiment 1), count the occurrences of a target digit in a rapid serial visual presentation (Experiment 2), or judge the pitch of a tone as high or low (Experiment 3). The visible face had an impact on judgments of the emotion of the heard voice in all the experiments. This cross-modal effect was independent of whether or not the subjects performed a demanding additional task. This suggests that integration of visual and auditory information about emotions may be a mandatory process, unconstrained by attentional resources.
Related Concept Videos
Emotional Expression
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Cognitive Theories: Schachter-Singer Theory of Emotion
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences physiological...
Cognitive Theories: Lazarus Mediational Theory of Emotion
Cognitive Appraisal and Emotional Response
Lazarus proposed that emotions are not solely...
Facial Feedback Hypothesis
The Influence of Cognition on Affect
Non-Verbal Cues

