Related Experiment Video
Updated: May 8, 2026
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
Affect recognition in traumatic brain injury: responses to unimodal and multimodal media
1Department of Applied Linguistics, Brock University, St. Catharines, Ontario, Canada (Dr Zupan); and Department of Physical Medicine and Rehabilitation, Indiana University School of Medicine and Rehabilitation Hospital of Indiana, Indiana (Dr Neumann).
Objectives:
To compare affect recognition by people with and without traumatic brain injury (TBI) for (1) unimodal and context-enriched multimodal media; (2) positive (happy) and negative emotions; and (3) neutral multimodal stimuli.
Participants:
A total of 60 people with moderate to severe TBI and 60 matched controls.
Measures:
(1) facial affect, (2) vocal affect, and (3) multimodal affect.
Results:
Compared with controls, people with TBI scored significantly lower on both unimodal measures but not on the multimodal measure. Within- group comparisons for people with TBI revealed that they were better at recognizing affect from multimodal than unimodal stimuli. As a group, participants with TBI who were categorized as having impaired facial/vocal affect recognition were less accurate at recognizing all emotions, including happy, than unimpaired participants. Neutral stimuli were more poorly identified by participants with TBI than by those with controls.
Conclusion:
Context-enriched multimodal stimuli may enhance affect recognition for people with TBI. People with TBI who have impaired affect recognition may have problems identifying both positive (happy) and negative expressions. Furthermore, people with TBI may perceive affect when there is none.
