心理健康问卷中内容重叠的观察者独立评估:基于大型语言模型的研究
Annkathrin Böke1, Hannah Hacker1, Millennia Chakraborty1
1Department of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Kerpener Str. 62, Cologne, 50931, Germany, 49 22147887150.
JMIR AI
|December 11, 2025
概括
大型语言模型 (LLM) 客观地评估心理健康问卷的内容重叠. 生成式预训练变压器 (GPT) 方法与专家评级一致,证明了观察者独立分析的可行性.
科学领域:
- 精神病学和心理健康 精神病学和心理健康
- 计算语言学 计算语言学
- 医疗信息学 医疗信息学
背景情况:
- 心理健康评估经常使用问卷,但在测量相同精神病理的工具之间存在显著的内容分歧.
- 之前的内容重叠研究依赖于耗时,依赖观察者的手动症状标签.
研究的目的:
- 采用大型语言模型 (LLM) 来对心理健康问卷中的内容重叠进行观察者独立的分析.
- 将LLM衍生结果与临床专业知识进行比较.
主要方法:
- 通过两种LLM方法对抑郁症,精神病风险,躁狂,强迫症和睡眠障碍的问卷进行分析:句子双向编码器从变压器 (sBERT) 和生成预训练变压器 (GPT) 的表示.
- 基于LLM的症状聚类与使用调整后的兰德指数的专家手册分类进行了比较.
- 诊断领域内的内容重叠使用LLM衍生集群进行了评估.
主要成果:
- 在专家和基于LLM的跨领域聚类之间观察到不同程度的相似性,GPT显示出比sBERT更好的对齐.
- 基于GPT的聚类显示,在分析的诊断领域 (例如,CHR-P:0.344到成人抑郁症:0.574) 中,调查问卷的内容重叠较弱至中等.
- 在LLM分析中,结果显示存在差异,但与之前的内容重叠手动调查没有实质性差异.
结论:
- 大型语言模型 (LLM) 为客观评估诊断问卷中的内容重叠提供了一种可行的方法.
- 生成性预训练变压器 (GPT) 方法在心理健康评估中显示出与专家衍生症状结构保持一致的重大前景.
相关概念视频
Higher Mental Functions of the Brain: Language
3.3K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.3K
Self-Report Tests of Personality
733
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
733
Reliability and Validity
13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Long-term Depression
33.0K
Long-term depression, or LTD, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTD is the process of synaptic weakening that occurs over time between pre and postsynaptic neuronal connections. The synaptic weakening of LTD works in opposition to synaptic strengthening by long-term potentiation (LTP) and together are the main mechanisms that underlie learning and memory.
33.0K
Long-term Depression
3.0K
Long-term depression, or LTD, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTD is the process of synaptic weakening that occurs over time between pre and postsynaptic neuronal connections. The synaptic weakening of LTD works in opposition to synaptic strengthening by long-term potentiation (LTP) and together are the main mechanisms that underlie learning and memory.
Calcium Ion Concentration Mechanism
If over...
Calcium Ion Concentration Mechanism
If over...
3.0K
Self-Discrepancy Theory
18.8K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.8K

