在临床推理中人类-人工智能合作的成功与失败:对具有挑战性的现实世界病例进行实验研究
Kai Tzu-Iunn Ong1, Junwon Seo2, Hyojun Kim1
1Department of Artificial Intelligence, Yonsei University College of Computing, Seoul, South Korea.
International journal of medical informatics
|February 14, 2026
概括
交谈式人类-人工智能协作 (HAC) 在眼科病例中提高了临床推理准确性. 然而,效率因任务难度而异,受人类,人工智能和需要进一步研究的任务因素限制.
科学领域:
- 眼科医生 眼科 眼科
- 人工智能的人工智能
- 临床决策 临床决策
背景情况:
- 使用大型语言模型 (LLM) 的对话式人类-人工智能协作 (HAC) 显示出增强临床推理的前景.
- 它在复杂的,专门的临床场景中的有效性需要进一步研究.
研究的目的:
- 评估HAC在具有挑战性的眼科病例中的有效性.
- 分析导致HAC成功和失败的因素.
主要方法:
- 一项涉及30个具有挑战性的眼科病例的交叉研究.
- 参与者 (眼科医生,住院医生,医学学生) 独立和与Claude-3.5-Sonnet (HAC) 合作工作.
- 评估了绩效准确性,信心,认知负担,并分析了LLM交互模式.
主要成果:
- HAC显著提高了平均准确性 (0.45到0.60) 和增加了信心,同时降低了认知负担.
- 在成功的HAC (F1=0.92) 与失败的HAC (F1=0.29) 中,LLM行为适当性更高.
- 对于 >47%的人类准确度的任务,准确度的增长是显著的,但对于<30%准确度的任务,并非如此.
结论:
- 在复杂的眼科决策中,HAC提供了好处.
- 由于人类,模型和任务特定因素存在限制.
- 需要进一步改进,以优化临床环境中的HAC.
相关概念视频
Reason and Intuition
7.5K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.5K
Reasoning
442
Reasoning is the action of thinking about something in a logical, sensible way. It is integral to problem-solving, decision-making, and critical thinking. Reasoning can be inductive or deductive. Reasoning involves transforming information into conclusions, which is essential for problem-solving, decision-making, and critical thinking.
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
442
Heart Failure III: Clinical Manifestations
648
Heart failure (HF) manifests primarily as dyspnea, fatigue, and fluid retention, resulting in peripheral and pulmonary edema. Symptoms may vary depending on which ventricle is more affected, left or right.Left-Sided Heart FailureAlso known as left ventricular failure, this condition results from the left ventricle's inability to fill or eject sufficient blood into the systemic circulation. It leads to pulmonary congestion, which occurs when the left ventricle fails to eject blood effectively...
648
Ecological Succession
21.7K
Ecological succession is influenced by the processes of facilitation, inhibition, and toleration. Facilitation occurs when early successional species create more favorable ecological conditions for subsequent species, such as enhanced nutrient, water, or light availability. In contrast, inhibition happens when early successional species create unfavorable ecological conditions for potential successive species, such as limiting resource availability. In some cases, later successional species...
21.7K
Deductive Reasoning
69.5K
Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
For example, a researcher can deduce specific predictions...
69.5K
Inductive Reasoning
68.1K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
68.1K


