扬声器转向意识日记化用于基于语音的认知评估
Sean Shensheng Xu1, Xiaoquan Ke2, Man-Wai Mak2
1School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China.
Frontiers in neuroscience
|January 31, 2024
概括
这项研究增强了演讲者对认知评估的日记化. 这种新方法在具有挑战性的条件下提高了准确性,并且可以识别演讲者的转换,帮助分析语音数据.
科学领域:
- 语音处理 语音处理
- 认知科学是一种认知科学.
- 生物医学工程 生物医学工程
背景情况:
- 在蒙特利尔认知评估 (MoCA) 等认知评估中,语音日记对于分析语音至关重要.
- 传统方法面临声学不匹配和准确识别MoCA录音中的扬声器转换的挑战.
研究的目的:
- 提议和评估三种用于MoCA录音中的演讲者日记的改进方法.
- 为了提高日记的准确性和针对各种不匹配条件的稳定性.
- 为了使数据集缺乏此信息的扬声器转换时间假设.
主要方法:
- 使用多尺度通道相互依赖的扬声器嵌入与Res2Net块,挤压和激发单元,以及依赖通道的注意力.
- 应用序列比较方法来实现整体的对话视图,以创建一个扬声器转向意识的评分矩阵.
- 整合一对相似度计,将本地和全球信息整合到分数矩阵中.
主要成果:
- 提议的改进在扬声器日记化方面明显优于传统的x-vector/PLDA系统.
- 在语言,年龄和麦克风不匹配的场景下表现出卓越的性能.
- 成功假设了扬声器转时间,提高了对各种数据集的适用性.
结论:
- 开发的扬声器日记化系统为语音认知障碍诊断提供了更高的准确性和稳定性.
- 该方法假设演讲者转换的能力使其对分析语音数据集非常有价值,即使是没有明确时间信息的语音数据集.
更多相关视频
05:48Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
1.5K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
771
相关概念视频
Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Chunking and Rehearsal in Sensory Memory
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of information more...
