ASR for emotional speech: clarifying the issues and enhancing performance

T Athanaselis1, S Bakamidis, I Dologlou

  • 1Department of Speech Technology, Institute for Language and Speech Processing (ILSP), Artemidos 6 & Epidavrou, GR-151 25 Maroussi, Athens, Greece. tathana@ilsp.gr

Summary

Recognizing emotional speech is challenging. Enhancing language models with more emotional content significantly improves the recognition of spontaneous emotional speech by approximately 20%.

Related Concept Videos

Therapeutic Communication01:30

Therapeutic Communication

Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Emotional Expression01:26

Emotional Expression

Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Self-Presentation01:25

Self-Presentation

Self-presentation is a fundamental aspect of social interaction, shaping both how others perceive individuals and how they view themselves. This dynamic process influences behaviors in various social settings, often leading people to adjust their appearance, speech, and demeanor to align with their desired identity. While self-presentation can be deliberate or unconscious, it plays a critical role in interpersonal relationships and self-perception.Forms of Self-PresentationSelf-presentation can...
Managing Impressions01:19

Managing Impressions

Impression management encompasses individuals' deliberate efforts to shape how others perceive them during social interactions. This behavior is often employed to conform to social norms, secure approval, or pursue specific goals. While it involves selective self-presentation, it is not necessarily deceptive; individuals frequently present authentic aspects of themselves that align with situational demands.Common strategies include:Ingratiation: where individuals use flattery or agreeableness...
Non-Verbal Cues01:29

Non-Verbal Cues

Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
Factors Influencing Attraction V: Social Skills01:29

Factors Influencing Attraction V: Social Skills

Social skills play a crucial role in shaping interpersonal interactions and enhancing individuals' ability to navigate various social environments successfully. These skills contribute to personal and professional success, influencing how others perceive and treat individuals. High social skills provide distinct advantages in numerous settings, including romantic relationships, politics, and legal proceedings. In courtroom settings, for instance, defendants who exhibit strong social skills are...