早期认知衰退的自动检测使用多模式特征融合和转移学习对现实世界的对话性语言进行学习
IEEE journal of biomedical and health informatics
|December 8, 2025
概括
使用语音分析,CognoMemory可以检测认知能力下降. 该系统在识别痴呆症和轻度认知障碍 (MCI) 中显示出高准确度,优于其他模型,并显示出强大的概括性.
科学领域:
- 神经学 神经学
- 计算语言学 计算语言学
- 人工智能的人工智能
背景情况:
- 早期发现认知能力下降,包括痴呆症和轻度认知障碍 (MCI),对于及时干预至关重要.
- 对话性语言包含微妙的语言和声学标记,表明认知变化.
- 现有的认知衰退检测方法往往缺乏广泛应用所需的准确性和效率.
研究的目的:
- 开发和评估CognoMemory,这是一个通过语音分析检测认知衰退的新系统.
- 为了比较多式特征融合和转移学习方法与已建立的大型语言模型 (LLM) 基于方法的性能.
- 评估CognoMemory模型在独立数据集上的通用性和稳定性.
主要方法:
- 从1639名参与者收集了307小时的真实世界对话演讲,使用虚拟代理和14个记忆探测问题.
- 从语音数据中提取了声学,语言特征和LLM嵌入.
- 采用基于CNN/Bi-LSTM的转移学习架构与多式联络功能融合,在子集上进行预训练,并对痴呆症,MCI和健康参与者组进行微调.
主要成果:
- 认知记忆系统仅使用最初的"动机"问题,实现了高F1分数 (0.83为双向分类,0.54为三向分类).
- 提出的方法在准确性方面超过了几种基于LLM的模型 (BART,DistilBERT,RoBERTa,HuBERT).
- 转移学习提高了3%的性能,提高了38%的速度;该模型在DementiaBank数据集上获得了0.89的F1得分,显示出强大的通用性.
结论:
- "CognoMemory"提供了一种高度准确和高效的方法,用于从对话性语言中检测认知衰退.
- 与LLM-only方法相比,多模式功能融合和CNN/Bi-LSTM转移学习架构展示了卓越的性能和稳定性.
- 该系统在数据集中进行概括的能力突出显示了其在早期认知衰退查中的现实世界的临床应用潜力.
相关概念视频
01:27Language and Cognition
693
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
693
01:30Cognitive Development During Adulthood
749
Cognitive development continues throughout adulthood, undergoing significant shifts across early, middle, and late stages. Individual transition occurs from adolescent idealism to pragmatic and adaptable thinking in early adulthood. During this period, individuals learn to integrate personal beliefs with the recognition that other perspectives are equally valid. Exposure to the complexities of modern society, diverse experiences, and higher education contribute to this adaptive thought process,...
749
01:21Cognitive Learning
975
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
975