在自动自杀风险评估中,大型语言模型的性能与人类专家的评级相比,自动自杀风险评估的性能相比
Julia Thomas1,2,3, Zohar Elyoseph4,5, Lars Kuchinke6
1krisenchat gGmbH, Berlin, Germany.
Scientific reports
|November 10, 2025
概括
大型语言模型 (LLM) 在临床数据中显示出对自杀风险评估的前景. 最佳条件涉及零温度和特定提示,但由于可变的项目有效性,LLM最适合初始选.
科学领域:
- 人工智能的人工智能
- 精神病学是一个精神病学.
- 临床心理学 临床心理学
背景情况:
- 大型语言模型 (LLM) 为心理诊断提供了潜力.
- 系统评估对于它们在临床环境中的可靠和有效应用至关重要.
- 自杀风险评估是一个关键领域,需要准确的评估工具.
研究的目的:
- 通过LLMs.研究可靠和有效的心理评估的条件.
- 将LLM生成的自杀风险评级与人类专家评级进行比较.
- 分析不同LLM配置对评估绩效的影响.
主要方法:
- 分析了100个青年危机文本,由四位专家使用护士全球自杀评估量表 (NGASR) 进行评级.
- LLM (Mixtral-8x7B-Instruct) 评级在三个温度设置和提示风格 (零射击,少数射击,思维链) 中生成.
- 相互评级可靠性的比较,LLM对人类的协议 (克里多夫的α),以及对人类评级的分类指标.
主要成果:
- 法律法规的配置显著影响了评估的可靠性和准确性.
- 在温度0时的零射击提示为高/非常高风险带来了完美的相互评级可靠性.
- 几次射击提示显示了非常高风险 (α=0.78) 和分类性能的最佳人 - 人工智能协议.
- 较低的温度始终提高了可靠性和准确性,但关键的临床项目显示出不良的有效性.
结论:
- 基于LLM的心理评估的最佳条件包括零温度和特定任务的提示.
- 在临床项目上的不一致表现和适度的人类-AI协议限制了LLM的初始查.
- 精心的参数控制和验证对于在心理评估中使用LLM至关重要.
更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
1.0K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.3K
相关概念视频
01:19Survival Tree
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a survival tree begins...
Building a Survival Tree
Constructing a survival tree begins...
01:29Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...