情感神经反应通过标记的关联对齐进行声化
Andrés Marino Álvarez-Meza1, Héctor Fabio Torres-Cardona2, Mauricio Orozco-Alzate1
1Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia.
Sensors (Basel, Switzerland)
|July 8, 2023
概括
这项研究引入了一种使用标记关联对齐 (LCA) 的新方法,从与情绪相关的大脑活动中生成音乐. 该方法有效地将神经反应转化为独特的声学输出,推进情感计算和声音合成.
科学领域:
- 神经科学是一个神经科学.
- 机器学习 机器学习
- 音乐信息检索 音乐信息检索
背景情况:
- 机器学习模型很难从不同的数据集中学习音乐结构.
- 将来自其他领域的模式适应到音乐创作中,带来了重大的挑战.
- 情感计算旨在弥合人类情绪和技术反应之间的差距.
研究的目的:
- 开发一种用于对情感音乐听力数据的神经反应的声化方法.
- 为了确定与音乐生成的听觉特征最一致的大脑特征.
- 为了解决神经和听觉数据的跨/内主体变异性.
主要方法:
- 标记的关联对齐 (LCA) 用于声化.
- 使用相锁定值和高斯函数连接来处理变化.
- 一个两步的LCA方法涉及中心化内核对齐和正规关联分析.
- 一个矢量量化变量自动编码器生成了声学包裹.
主要成果:
- 通过LCA方法,成功地确定了对应的大脑和听觉特征.
- 该方法证明了从情感引起的神经活动中产生低级音乐的能力.
- 生成的声学输出保持了不同情绪状态之间的区别.
- 通过估计大脑神经特征的贡献,使生理学解释成为可能.
结论:
- 开发的LCA方法为情感驱动的声音合成提供了一种可行的方法.
- 这项技术通过将神经信号与听觉创造联系起来,推进了情感计算领域.
- 这些发现为艺术创新和个性化媒体体验的新应用铺平了道路.
相关概念视频
Labeling Emotion
185
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
185
Perceiving Loudness, Pitch, and Location
241
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
241
Hearing
52.5K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.5K


