同步分析语音生产和唇部运动,以使用深度学习方法检测帕金森病
Cristian David Ríos-Urrego1, Daniel Escobar-Grisales1, Juan Rafael Orozco-Arroyave1,2
1GITA Lab., Faculty of Engineering, University of Antioquia, Medellín 050010, Colombia.
Diagnostics (Basel, Switzerland)
|January 11, 2025
概括
这项研究引入了一种新的双模式方法来诊断帕金森病 (PD) 通过同步融合语音和唇部运动数据. 与单模或异步技术相比,这种方法显著提高了分类准确性.
科学领域:
- 生物医学工程 生物医学工程
- 计算语言学 计算语言学
- 神经学 神经学
背景情况:
- 帕金森病 (PD) 在全球影响超过600万,需要准确的诊断和监测.
- 目前用于PD检测的自动化方法通常依赖于孤立的语音或面部视频分析.
- 现有的方法很难充分利用语音和视觉线索中存在的互补信息.
研究的目的:
- 引入一种用于检测帕金森病的新型双模方法.
- 执行语音信号和唇部运动视频的同步融合,以增强PD模式建模.
- 评估这种双模式方法与单模式和异步方法的有效性.
主要方法:
- 开发了一种用于同步融合语音和唇部运动数据的新方法.
- 实施了一种双式方法,整合来自音频和视觉 (唇部运动) 记录的信息.
- 利用注意力机制进行同步的语音到嘴唇和嘴唇到语音信息融合.
主要成果:
- 同步双模方法表现出比单模方法更高的准确性和适用性.
- 拟议的方法优于忽视时间信息的经典异步聚变技术.
- 结果证实了在使用先进的融合策略时,唇部运动和语音生成的互补性质.
结论:
- 使用基于注意力的连接投影的同步融合显著改善了帕金森病的分类.
- 结合视觉和语音信号的多模式方法为临床诊断支持提供了强大而自信的模型.
- 这项研究强调了先进的多式联接融合在改善PD诊断和患者管理方面的潜力.
相关概念视频
Parkinson's Disease: Overview
472
Neurodegenerative disorders are progressive diseases that cause irreversible damage and loss to neurons in specific brain areas. Examples of these disorders include Parkinson's disease, Alzheimer's disease, Multiple Sclerosis (MS), and Amyotrophic Lateral Sclerosis (ALS). These disorders share characteristics such as proteinopathies, selective neuronal vulnerability, and a complex interplay between genetic and environmental factors. The primary therapeutic goal for these conditions is...
472
Parkinson's Disease: Treatment
215
Neurodegenerative disorders, such as Parkinson's Disease (PD), involve the gradual and irreversible destruction of neurons in particular brain areas. These disorders exhibit standard features like proteinopathies, selective vulnerability of some neurons, and an interaction of intrinsic properties, genetics, and environmental influences in neural injury.
Parkinson's Disease is primarily a result of the loss of dopaminergic neurons in the substantia nigra pars compacta. The cornerstone of...
Parkinson's Disease is primarily a result of the loss of dopaminergic neurons in the substantia nigra pars compacta. The cornerstone of...
215
Neural Regulation
39.1K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.1K


