一个医疗问题的数据集与自动生成的答案和证据支持的引用相结合
Deepak Gupta1, Davis Bartels2, Dina Demner-Fushman2
1National Library of Medicine, National Institutes of Health, HHS, Bethesda, MD, USA. deepak.gupta@nih.gov.
Scientific data
|June 19, 2025
概括
需要新的数据集来确保医疗人工智能答案是事实上的. MedAESQA数据集有助于训练和评估人工智能,将答案与支持科学证据联系起来,改进医疗问题答案系统.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 展示了医疗问题答案的先进能力,提高了答案质量.
- 然而,LLM生成的答案可能缺乏事实准确性,造成错误信息的风险.
- 需要数据集来评估和增强人工智能生成的医疗信息的真实性.
研究的目的:
- 介绍MedAESQA数据集,用于评估基于证据的医学问题答案.
- 促进事实归因的语言模型的开发和微调.
- 能够可靠地检测出没有科学证据支持的AI产生的答案.
主要方法:
- 开发了MedAESQA,一个数据集,包含40个汇总的,非识别的医疗问题.
- 每个问题包括30个人类和LLM生成的答案,每个陈述都与支持科学摘要相关.
- 包含关于陈述准确性和科学论文相关性的手册判断.
主要成果:
- MedAESQA数据集为评估医疗人工智能的事实准确性提供了一个基准.
- 它可以评估AI引用和将陈述链接到可靠来源的能力.
- 促进对强大方法的研究,以检测医疗AI中未经支持的索赔.
结论:
- MedAESQA对于推进可信的医疗问题答案系统至关重要.
- 该数据集支持创建能够生成事实可归因和基于证据的响应的人工智能.
- 提高了在医疗保健LLM应用程序的可靠性和安全性.
相关概念视频
Data Collection I
6.8K
Data collection gathers information needed to make accurate judgments about a patient's present condition. During a health history interview, subjective data is collected from the patient, their caregivers, or family members, and objective data is collected through observations and physical assessment. Patients are the primary source of subjective data. Thus information gathered from patients through interviews, observations, and physical examination is primary data. Secondary sources of...
6.8K
The Availability Heuristic
6.4K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.4K
Combination Therapies and Personalized Medicine
5.1K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
5.1K
Statistical Software for Data Analysis and Clinical Trials
803
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
803
Hazard Ratio
261
The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
For example, in a clinical trial...
261
Nursing Clinical Information System
879
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
879


