Related Experiment Video
Updated: Jan 25, 2026

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
Published on: May 15, 2016
Heart sound signals can be used for emotion recognition
Cheng Xiefeng1, Yue Wang1, Shicheng Dai2
1College of Electronic and Optical Engineering, Nanjing University of Posts and Telecommunications, Nanjing, 210003, China.
Abstract:
This article studies whether heart sound signals can be used for emotion recognition. First, we built a small emotion heart sound database, and simultaneously recorded the participants' ECG for comparative analysis. Second, according to the characteristics of the heart sound signals, two emotion evaluation indicators were proposed: HRV of heart sounds (difference between successive heartbeats) and DSV of heart sounds (the ratio of diastolic to systolic duration variability). Then, we extracted linear and nonlinear features from two emotion evaluation indicators to recognize four kinds of emotions. Moreover, we used valence dimension, arousal dimension and valence-arousal synthesis as evaluation standards. The experimental results demonstrated that heart sound signals can be used for emotion recognition. It was more effective to achieve recognition results by combining the features of HRV and DSV of heart sounds. Finally, the average accuracy of four emotion recognitions on valence dimension, arousal dimension and valence-arousal synthesis was up to 96.875%, 88.5417% and 81.25%, respectively.
Related Concept Videos
Heart Sounds
Auscultation is the process of listening to these internal body sounds using a stethoscope. The heart produces four types of sounds, but only two—S1 and S2—can usually be heard with a stethoscope.
S1, also known as the "lub" sound, is caused by the closure of atrioventricular (A-V)...
Soundness of Cement
Korotkoff Sounds
During blood pressure assessment, inflating the cuff 30 millimeters of mercury above the patient's systolic blood pressure...
Physiology of Emotion
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Emotional Expression
Universal Facial Expressions
Psychologist Paul Ekman identified seven basic...
Sound Waves
Sound waves are longitudinal in most fluids because fluids cannot sustain any lateral pressure. In solids, however, shear forces help in propagating the disturbance in the lateral direction as well....

