Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Non-Verbal Cues01:29

Non-Verbal Cues

360
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
360
Emotional Expression01:26

Emotional Expression

1.1K
Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
1.1K
Labeling Emotion01:20

Labeling Emotion

769
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
769
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

699
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
699
Therapeutic Communication01:30

Therapeutic Communication

8.9K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
8.9K
Cognitive Theories: Schachter-Singer Theory of Emotion01:20

Cognitive Theories: Schachter-Singer Theory of Emotion

1.9K
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
1.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Skeleton Reconstruction Using Generative Adversarial Networks for Human Activity Recognition Under Occlusion.

Sensors (Basel, Switzerland)·2025
Same author

Leveraging Artificial Occluded Samples for Data Augmentation in Human Activity Recognition.

Sensors (Basel, Switzerland)·2025
Same author

A Multi-Modal Egocentric Activity Recognition Approach towards Video Domain Generalization.

Sensors (Basel, Switzerland)·2024
Same author

Atrial fibrillation in human patients is associated with increased collagen type V and TGFbeta1.

International journal of cardiology. Heart & vasculature·2024
Same author

Coronary microthrombi in the failing human heart: the role of von Willebrand factor and PECAM-1.

Molecular and cellular biochemistry·2024
Same author

A multimodal dataset for electric guitar playing technique recognition.

Data in brief·2023

Related Experiment Video

Updated: Feb 21, 2026

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.0K

Recognizing Emotional States Using Speech Information.

Michalis Papakostas1, Giorgos Siantikos2, Theodoros Giannakopoulos2

  • 1Computer Science and Engineering Department, University of Texas at Arlington, Arlington, TX, USA.

Advances in Experimental Medicine and Biology
|October 4, 2017
PubMed
Summary
This summary is machine-generated.

This study compares machine learning models for voice-based emotion recognition using paralinguistic features. Both Convolutional Neural Networks and Support Vector Machines show promise for multilingual emotion detection from speech.

Keywords:
Convolutional neural networksEmotion recognitionSpeech informationSupport vector machinesTransfer learning

More Related Videos

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.5K
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.5K

Related Experiment Videos

Last Updated: Feb 21, 2026

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.0K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.5K
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.5K

Area of Science:

  • Speech processing
  • Machine learning
  • Affective computing

Background:

  • Emotion recognition is crucial for human-computer interaction and monitoring user states.
  • Voice is a key modality for emotion recognition, especially when other data is unavailable.
  • Existing methods often rely on linguistic content, but paralinguistic cues offer a distinct avenue.

Purpose of the Study:

  • To analyze speaker emotions using solely paralinguistic information from voice.
  • To compare the effectiveness of Convolutional Neural Networks (CNNs) and Support Vector Machines (SVMs) for this task.
  • To develop a multilingual emotion recognition system.

Main Methods:

  • Utilized Convolutional Neural Networks (CNNs) trained on raw speech data.
  • Employed Support Vector Machines (SVMs) trained on extracted low-level acoustic features.
  • Compiled multilingual datasets for training and testing to ensure broad applicability.

Main Results:

  • Both CNN and SVM models demonstrated capability in recognizing emotions from speech.
  • Paralinguistic analysis proved effective for emotion detection across different languages.
  • The study provides a comparative analysis of two distinct machine learning approaches.

Conclusions:

  • Voice-based emotion recognition using paralinguistic features is feasible with current machine learning techniques.
  • CNNs and SVMs offer viable, albeit different, pathways for developing such systems.
  • The proposed multilingual approach enhances the potential for real-world applications.