大型语言模型在临床问题解决中的局限性来自于不灵活的推理
Jonathan Kim1, Anna Podlasek2, Kie Shidara3
1Department of Neurology and Neurologic Sciences, Stanford University, Palo Alto, CA, USA.
Scientific reports
|November 11, 2025
概括
大型语言模型 (LLM) 显示出临床推理的局限性,尽管在基准测试中得分高. 新的测试显示,LLM在灵活解决医疗问题方面扎,并表现出过度自信.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 认知科学 认知科学
背景情况:
- 大型语言模型 (LLM) 在医疗问答任务中展示了人类水平的表现.
- 对于LLM在复杂的临床场景中需要灵活推理的稳定性和概括性存在担忧.
研究的目的:
- 在临床问题解决中评估LLM推理能力.
- 通过使用mARC-QA基准来识别LLM医学推理中的故障模式.
- 评估LLM对 Einstellung效应的敏感性.
主要方法:
- 医学抽象和推理集体 (mARC-QA) 数据集的开发.
- 设计用于利用认知偏见和测试灵活推理的mARC-QA场景.
- 对领先的LLM (如Gemini,Claude) 与医生的表现进行评估.
主要成果:
- 在mARC-QA基准测试中,LLM的表现明显低于医生.
- LLM在常识医学推理方面表现出缺陷,并倾向于幻觉.
- 学生对自己的错误答案表现出过度的信心,不确定性估计很差.
结论:
- 当前的LLM在临床推理方面表现出严重的局限性,特别是在灵活解决问题的方面.
- 设置效应突出显示了LLM对不灵活模式匹配的诱导偏见.
- 建议在现实临床环境中部署LLM时谨慎使用,因为已识别的故障模式.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.3K
05:48The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
Published on: June 12, 2020
6.3K
相关概念视频
Language and Cognition
700
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
700
Reasoning
388
Reasoning is the action of thinking about something in a logical, sensible way. It is integral to problem-solving, decision-making, and critical thinking. Reasoning can be inductive or deductive. Reasoning involves transforming information into conclusions, which is essential for problem-solving, decision-making, and critical thinking.
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
388
Problem-Solving
477
Effective problem-solving consists of two steps: 1. identifying the problem and 2. selecting the appropriate problem-solving strategy (i.e., a plan of action used to find a solution). Humans use four problem-solving strategies:
477
Critical Thinking II
4.0K
Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
4.0K
Inductive Reasoning
64.5K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
64.5K
Cognitive Learning
990
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
990
