声学驱动的语音删除,保留了声乐情感曲线
Camille Noufi1, Jonathan Berger1, Michael Frank2
1Stanford University, Center for Computer Research in Music and Acoustics, Stanford, CA, USA.
概括
这项研究引入了一种新的方法,通过删除语言语音信息来隔离声乐影响线索. 这种技术有效地捕获临床应用的双语指标,有助于影响识别.
科学领域:
- 语音处理 语音处理
- 生物声学是一种生物声学.
- 情感计算是一种情感计算.
背景情况:
- 评估语音影响在临床环境中至关重要.
- 临床人群中语言障碍的混会影响检测.
- 现有的方法很难将语言特征和语言特征分开.
研究的目的:
- 开发一种方法来从语音中删除语言信息.
- 为了隔离对语言影响的指标,用于客观测量.
- 创建一种用于临床测试的声音影响敏感性的工具,不受语言缺陷的阻碍.
主要方法:
- 同时录制语音音频和电声学 (EGG) 信号.
- 从音频中估计声道波器响应和振幅包裹.
- 使用EGG信号进行语音源活动,独立于语音表达.
- 开发一个转换的信号,最大限度地提高双语线索,同时最大限度地减少语音信息.
主要成果:
- 创建了一个新的信号来捕获生物声学线索以影响.
- 转换的信号成功地消除了语音线索的语言含义.
- 感知实验表明,关于感知影响的原始和转换信号之间存在很高的相似性.
- 在线听众对匹配的音频和EGG衍生信号显示出一致的影响评级.
结论:
- 拟议的方法有效地将 paralinguistic 情感线索与语音中的语言内容分开.
- 这种技术在临床评估声声影响识别方面具有显著的潜力.
- 这些发现证实了该方法在保存和突出表现情感声乐特征方面的有效性.
相关概念视频
Facial Feedback Hypothesis
186
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
186
Auditory Pathway
5.5K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.5K
Auditory Perception
363
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
363
Larynx
1.6K
The human larynx, often referred to as the voice box, is an intricate organ located in the neck. It serves as a pathway for air to enter the lungs during respiration and is an essential component of voice production.
Anatomy of the Larynx
The larynx consists of various components, including cartilage, muscles, and vocal cords. Its structure includes three large unpaired cartilages—the thyroid, cricoid, and epiglottis—and three smaller paired cartilages—the arytenoids,...
Anatomy of the Larynx
The larynx consists of various components, including cartilage, muscles, and vocal cords. Its structure includes three large unpaired cartilages—the thyroid, cricoid, and epiglottis—and three smaller paired cartilages—the arytenoids,...
1.6K


