Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Labeling Emotion01:20

Labeling Emotion

Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
Classification of Signals01:30

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Physiology of Emotion01:20

Physiology of Emotion

The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Emotional Expression01:26

Emotional Expression

Emotional expression encompasses how individuals convey their emotions through verbal communication and non-verbal cues. These non-verbal actions include facial expressions, body language, and physical gestures, such as frowning or smiling. Among these, facial expressions play a crucial role in emotional expression and are understood universally, indicating a biological basis for how humans communicate emotions.
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
IR Frequency Region: Fingerprint Region01:03

IR Frequency Region: Fingerprint Region

IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the C=O, C=N, and C=C occur between 1600–1850 cm−1.
The...
Non-Verbal Cues01:29

Non-Verbal Cues

Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Personalized machine learning-guided radiation dose escalation in newly diagnosed glioblastoma: prospective pilot study.

Nature communications·2026
Same author

Making MRI Clinically Useful in Traumatic Brain Injury: From Patterns to Individuals.

Neurology·2026
Same author

Glymphatic System Dysfunction and Diffusion Tensor Imaging Along the Perivascular Space in Traumatic Brain Injury: A Systematic Review and Meta-Analysis.

AJNR. American journal of neuroradiology·2026
Same author

Big Data, Small Bias: Harmonizing Diffusion MRI-Based Structural Connectomes to Mitigate Site-Related Bias in Data Integration.

Human brain mapping·2025
Same author

Linking Symptom Inventories Using Semantic Textual Similarity.

Journal of neurotrauma·2025
Same author

Improvement of diffusion tensor imaging-based tractography by free-water correction in nonedematous gliomas: assessment with brain mapping.

Journal of neurosurgery·2024
Same journal

Read speech voice quality and disfluency in individuals with recent suicidal ideation or suicide attempt.

Speech communication·2026
Same journal

Speechformer-CTC: Sequential Modeling of Depression Detection with Speech Temporal Classification.

Speech communication·2024
Same journal

Temporal envelope cues and simulations of cochlear implant signal processing.

Speech communication·2024
Same journal

Post-Processing Automatic Transcriptions with Machine Learning for Verbal Fluency Scoring.

Speech communication·2024
Same journal

Analysis of acoustic and voice quality features for the classification of infant and mother vocalizations.

Speech communication·2022
Same journal

Audibility emphasis of low-level sounds improves consonant identification while preserving vowel identification for cochlear implant users.

Speech communication·2022
See all related articles

Related Experiment Videos

Class-Level Spectral Features for Emotion Recognition.

Dmitri Bitouk1, Ragini Verma, Ani Nenkova

  • 1Department of Radiology, Section of Biomedical Image Analysis, University of Pennsylvania, 3600 Market street, Suite 380, Philadelphia, PA 19104.

Speech Communication
|June 25, 2013
PubMed
Summary
This summary is machine-generated.

New spectral features analyzing phoneme types significantly improve automatic emotion recognition accuracy. Consonant-based features are most informative, outperforming traditional prosodic methods.

Related Experiment Videos

Area of Science:

  • Speech processing
  • Affective computing
  • Machine learning

Background:

  • Automatic emotion recognition commonly uses prosodic features.
  • Recent research highlights the value of segmental spectral features for emotion detection.

Purpose of the Study:

  • Introduce fine-grained spectral features based on phoneme classes.
  • Evaluate these features for speaker-independent emotion recognition.
  • Compare performance against existing methods.

Main Methods:

  • Computed statistics of Mel-Frequency Cepstral Coefficients (MFCCs) for stressed vowels, unstressed vowels, and consonants.
  • Tested features on two public datasets for speaker-independent emotion recognition.
  • Investigated feature selection and the impact of utterance length.

Main Results:

  • Phoneme-class-based spectral features significantly improved emotion recognition accuracy.
  • Consonant features provided more emotional information than vowel features.
  • Combining spectral and prosodic features yielded further gains.
  • Feature selection did not consistently improve results.
  • Accuracy increased with utterance length for spectral features.

Conclusions:

  • Differentiating phoneme types enhances spectral feature effectiveness for emotion recognition.
  • Consonant spectral features are particularly valuable.
  • Longer utterances benefit spectral feature-based emotion recognition.