具有预定义的验证步骤的双阶段提示框架,用于评估两个数据集上的诊断推理任务
1Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China.
NPJ digital medicine
|December 16, 2025
概括
一个新的两阶段提示框架显著改善了大语言模型 (LLM) 诊断推理. 这种方法通过结合验证步骤来提高医学诊断的准确性和一致性.
科学领域:
- 人工智能在医学中的应用
- 医疗信息学 医疗信息学
- 临床决策支持系统 临床决策支持系统
背景情况:
- 大型语言模型 (LLM) 在医疗保健方面表现有前途,但在准确的医学诊断推理方面存在困难.
- 现有的LLM提示方法可能无法充分利用它们对复杂临床任务的潜力.
研究的目的:
- 评估一种新的两阶段提示框架 (初始诊断 → 验证 → 最终诊断) 来增强LLM诊断推理.
- 与标准方法相比,评估该框架对准确性,不确定性,一致性和推理错误的影响.
主要方法:
- 这项研究使用了GPT-4o和DeepSeek-V3模型对589个MedQA-USMLE和300个NEJM病例进行了研究.
- 实施和测试了具有预定义验证步骤的两阶段提示框架.
- 病例被采样了五次,诊断被盲目的,经过董事会认证的医生评估.
主要成果:
- 两个阶段的框架提高了最终诊断的准确性高达5.2%,减少了16.0%的不确定性,并增加了23.3%的一致性.
- 这种方法导致不正确的医学知识错误减少了63.0%.
- 与思维链相比,该框架的准确性高达4.0%,一致性高达11.0%.
结论:
- 具有验证步骤的两阶段提示框架表明了改善医学应用中的LLM诊断推理的潜力.
- 这些发现表明,在临床决策支持中提高AI可靠性和准确性的可行策略.
- 建议对各种数据集和模型进行进一步验证,以确认可通用性.
相关概念视频
Inductive Reasoning
64.4K
Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
64.4K
Deductive Reasoning
63.7K
Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
For example, a researcher can deduce specific predictions...
63.7K
Reasoning
377
Reasoning is the action of thinking about something in a logical, sensible way. It is integral to problem-solving, decision-making, and critical thinking. Reasoning can be inductive or deductive. Reasoning involves transforming information into conclusions, which is essential for problem-solving, decision-making, and critical thinking.
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
377
Critical Thinking II
4.0K
Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
4.0K
Data Validation
6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
Formulating and Validating Nursing Diagnosis II
3.5K
Nursing diagnoses represent a problem validated by major defining characteristics. There are four categories of nursing diagnoses: problem-focused, risk, health promotion or wellness, and syndrome. The anatomy of a nursing diagnosis includes three components: problem statement or diagnostic label, defining characteristics, and related factors.
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
3.5K


