Related Experiment Video
Updated: Jul 24, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
Manifestation of depression in speech overlaps with characteristics used to represent and recognize speaker identity
Sri Harsha Dumpala1,2, Katerina Dikaios3,4, Sebastian Rodriguez1,2
1Faculty of Computer Science, Dalhousie University, Halifax, NS, Canada.
Abstract:
The sound of a person's voice is commonly used to identify the speaker. The sound of speech is also starting to be used to detect medical conditions, such as depression. It is not known whether the manifestations of depression in speech overlap with those used to identify the speaker. In this paper, we test the hypothesis that the representations of personal identity in speech, known as speaker embeddings, improve the detection of depression and estimation of depressive symptoms severity. We further examine whether changes in depression severity interfere with the recognition of speaker's identity. We extract speaker embeddings from models pre-trained on a large sample of speakers from the general population without information on depression diagnosis. We test these speaker embeddings for severity estimation in independent datasets consisting of clinical interviews (DAIC-WOZ), spontaneous speech (VocalMind), and longitudinal data (VocalMind). We also use the severity estimates to predict presence of depression. Speaker embeddings, combined with established acoustic features (OpenSMILE), predicted severity with root mean square error (RMSE) values of 6.01 and 6.28 in DAIC-WOZ and VocalMind datasets, respectively, lower than acoustic features alone or speaker embeddings alone. When used to detect depression, speaker embeddings showed higher balanced accuracy (BAc) and surpassed previous state-of-the-art performance in depression detection from speech, with BAc values of 66% and 64% in DAIC-WOZ and VocalMind datasets, respectively. Results from a subset of participants with repeated speech samples show that the speaker identification is affected by changes in depression severity. These results suggest that depression overlaps with personal identity in the acoustic space. While speaker embeddings improve depression detection and severity estimation, deterioration or improvement in mood may interfere with speaker verification.
More Related Videos
Related Concept Videos
Depression: Overview
Depressive Disorders: Etiology
Biological Factors in Depression
Biological predispositions significantly influence the risk of developing depressive disorders. Genetic studies highlight the role of variations in the serotonin transporter...
Depressive Disorders: MDD and Dysthymia
Self-Presentation: Self-Monitoring and Self-Handicapping
Negative and Cognitive Symptoms of Schizophrenia
Negative Symptoms
Negative symptoms of schizophrenia manifest as deficits in normal emotional and behavioral functioning, profoundly impacting daily life. Individuals with schizophrenia often display a flat affect, characterized by a near-total absence of emotional expression,...
Dissociative Identity Disorder

