Related Experiment Video
Updated: Jun 21, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
Instrumental music influences recognition of emotional body language
Jan Van den Stock1, Isabelle Peretz, Julie Grèzes
1Laboratory of Cognitive and Affective Neuroscience, Tilburg University, P.O. Box 90153, 5000 LE, Tilburg, The Netherlands.
Abstract:
In everyday life, emotional events are perceived by multiple sensory systems. Research has shown that recognition of emotions in one modality is biased towards the emotion expressed in a simultaneously presented but task irrelevant modality. In the present study, we combine visual and auditory stimuli that convey similar affective meaning but have a low probability of co-occurrence in everyday life. Dynamic face-blurred whole body expressions of a person grasping an object while expressing happiness or sadness are presented in combination with fragments of happy or sad instrumental classical music. Participants were instructed to categorize the emotion expressed by the visual stimulus. The results show that recognition of body language is influenced by the auditory stimuli. These findings indicate that crossmodal influences as previously observed for audiovisual speech can also be obtained from the ignored auditory to the attended visual modality in audiovisual stimuli that consist of whole bodies and music.
Related Concept Videos
Channels of Non-Verbal Communication
Non-Verbal Cues
Emotional Expression
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Labeling Emotion
Facial Feedback Hypothesis
Therapeutic Communication
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
