可解释的深度学习揭示了感知音乐情绪的独特的光谱和时间驱动因素
Scientific reports
|January 6, 2026
概括
这项研究揭示了特定的音乐特征如何影响情绪. 节奏的规律性和光谱流量预测了兴奋,而调的复杂性和模式预测了价值,推进了音乐心理学理论.
科学领域:
- 音乐心理学 音乐心理学
- 计算式听觉神经科学 计算式听觉神经科学
- 机器学习 机器学习
背景情况:
- 了解声学特征与音乐引起的情绪 (价值和兴奋) 之间的联系是音乐心理学的一个关键挑战.
- 现有的模型往往缺乏可解释性,或者没有基于心理学理论,这限制了它们在推进认知理论方面的实用性.
研究的目的:
- 开发和验证一种可解释的,以理论为指导的计算模型,用于预测对音乐的情绪反应.
- 识别特定的声学特征,预测音乐听众的价值和兴奋.
- 为测试和完善音乐认知和情感理论提供一个工具.
主要方法:
- 开发了一种新的神经网络,集成卷积和变压路径,用于光谱和时间分析.
- 限制模型的学习过程与音乐心理学的既定原则.
- 使用了DEAM数据集 (1802个音乐摘录,具有连续的价值激发评级).
- 分析了模型注意力机制,以确定关键的声学预测因素.
主要成果:
- 独特的声学特征预测了价值和兴奋:节奏规律性和光谱流量用于兴奋;和声复杂性和音乐模式用于价值.
- 理论导向的模型显著优于标准基线,达到0.67的价值和0.73的兴奋的CCCs.
- 一项废除研究证实了理论指导的约束对于卓越性能的重要作用.
结论:
- 提供了强有力的计算证据,证明不同的时间和光谱声学特征在情绪感知中的作用.
- 展示了可解释机器学习在音乐认知中的心理理论测试中的实用性.
- 强调将心理学原则纳入计算模型的重要性,以提高可信性和性能.
相关概念视频
Labeling Emotion
594
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
594
Perceiving Loudness, Pitch, and Location
925
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
925
Auditory Perception
1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K
Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K
Cognitive Theories: Schachter-Singer Theory of Emotion
1.5K
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
1.5K
Physiology of Emotion
3.1K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
3.1K


