在精神病学中评估聊天机器人:对临床知识和推理的基于Rash的见解
Yu Chang1,2, Si-Sheng Huang3,4, Wen-Yu Hsu2,3,4
1Department of Psychiatry, Chung Shan Medical University Hospital, Taichung, Taiwan.
PloS one
|August 14, 2025
概括
领先的聊天机器人显示了精神病临床支持的潜力,ChatGPT-o1-preview在知识和推理方面表现出色. 然而,局限性突显出需要人工智能集成的人类监督,以确保患者安全.
科学领域:
- 精神病学是一个精神病学.
- 人工智能的人工智能
- 医疗信息学 医疗信息学
背景情况:
- 聊天机器人正在成为精神病学临床支持的工具.
- 评估这些人工智能工具的功能对于安全集成至关重要.
研究的目的:
- 系统地评估27个精神病学领先的聊天机器人的临床知识和推理能力.
- 确定当前人工智能在精神病学决策支持中的优点和局限性.
主要方法:
- 利用来自台湾精神病学执照考试的160个多选题.
- 用Rasch分析进行量化绩效评估.
- 对聊天机器人的推理过程进行了定性评估.
主要成果:
- OpenAI的ChatGPT-o1预览版获得了2.23的Rash能力得分,超过了通过值 (p < 0.001).
- 聊天GPT表现出强大的诊断和治疗推理,但在事实回忆和利基主题方面存在局限性.
- 在一些聊天机器人响应中发现了推理偏见.
结论:
- 先进的聊天机器人显示出作为精神病学临床决策支持工具的巨大潜力.
- 目前的AI限制需要严格的人类监督,以确保患者的安全.
- 持续评估和特定领域的培训对于在临床实践中安全实施AI至关重要.
相关概念视频
Rational Emotive Behavior Therapy
111
Cognitive-behavioral therapies (CBTs) are grounded in the belief that our thoughts profoundly influence our emotions and actions. Advocates of CBT emphasize three core assumptions: first, that cognitions are identifiable and measurable; second, that they are central to psychological functioning; and third, that irrational or maladaptive beliefs can be replaced with rational and adaptive ones. This transformative approach to therapy has paved the way for specific models such as Albert...
111
Reason and Intuition
6.9K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.9K
Psychosurgery
106
Psychosurgery, the surgical alteration or permanent removal of brain tissue to alleviate severe psychological conditions, stands as one of the most radical and controversial treatments in the history of mental health care. Its development and application have evolved significantly, marked by dramatic shifts in scientific understanding and ethical perspectives.
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...
106
Diagnostic and Statistical Manual of Mental Disorders (DSM)
149
The Diagnostic and Statistical Manual of Mental Disorders (DSM) serves as the primary classification system for mental health disorders, providing standardized diagnostic criteria for clinicians and researchers. First published by the American Psychiatric Association (APA) in 1952, the DSM has undergone several revisions to reflect evolving psychiatric understanding. The fifth edition, DSM-5, released in 2013, introduced key updates that expanded diagnostic categories and modified diagnostic...
149
Patient-centered Care
2.3K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.3K
Introduction to Cognitive Psychology
818
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
818


