Related Experiment Video
Updated: Apr 7, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
Using music[al] knowledge to represent expressions of emotions
Stewart C Alexander1, David Kirkland Garner2, Matthew Somoroff2
1Department of Consumer Science, Purdue University, West Lafayette, IN, USA; Department of Medicine, Duke University Medical Center, Durham, NC, USA; Health Services Research and Development Service, Durham VA Medical Center, Durham, NC, USA.
Objective:
Being able to identify expressions of emotion is crucial to effective clinical communication research. However, traditional linguistic coding systems often cannot represent emotions that are expressed nonlexically or phonologically (i.e., not through words themselves but through vocal pitch, speed/rhythm/tempo, and volume).
Methods:
Using audio recording of a palliative care consultation in the natural hospital setting, two experienced music scholars employed Western musical notation, as well as the graphic realization of a digital audio program (Piano roll visualization), to visually represent the sonic features of conversation where a patient has an emotional "choke" moment.
Results:
Western musical notation showed the ways that changes in pitch and rate correspond to the patient's emotion: rising sharply in intensity before slowly fading away. Piano roll visualization is a helpful supplement.
Conclusions:
Using musical notation to illustrate palliative care conversations in the hospital setting can render visible for analysis several aspects of emotional expression that researchers otherwise experience as intuitive or subjective. Various forms and formats of musical notation techniques and sonic visualization technologies should be considered as fruitful and complementary alternatives to traditional coding tools in clinical communications research.
Practice Implications:
Musical notation offers opportunity for both researchers and learners to "see" how communication evolves in clinical encounters, particularly where the lexical and phonological features of interpersonal communication are concordant and discordant with one another.
Related Concept Videos
Emotional Expression
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Labeling Emotion
Facial Feedback Hypothesis
Non-Verbal Cues
Physiology of Emotion
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Therapeutic Communication
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...

