使用人工智能加速系统审查的速度和准确性:一个验证研究
Jiada Zhan1, Kara Suvada2, Muwu Xu3
1Nutrition and Health Sciences, Laney Graduate School, Emory University, Atlanta, GA, USA. jzha832@emory.edu.
Systematic reviews
|December 19, 2025
概括
人工智能 (AI) 显著提高了系统审查的效率,比人类更快地选标题/摘要和全文文章. 虽然人工智能在初始选中表现出高精度,但在全文审查中其表现需要仔细考虑.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 系统审查方法论 系统审查方法论
背景情况:
- 人工智能 (AI) 在系统文献评论和元分析中提供了潜在的效率增长.
- 人工智能工具在选标题/摘要和全文文章中的准确性仍然不确定.
研究的目的:
- 为了评估GPT-4人工智能程序的性能指标,请检查副驾驶员.
- 在选系统审查文章中,将AI性能与人类决策 (黄金标准) 进行比较.
主要方法:
- 利用了来自四个已发表的系统性审查/元分析的参与者数据.
- 对比审查Copilot对标题/摘要和全文文章的人类选的敏感性和特异性.
- 分析了查时间,运行之间的一致性和kappa统计数据.
主要成果:
- 审查Copilot在标题/抽象选中实现了99.2%的灵敏度和83.6%的特异性.
- 全文查的敏感度为97.6%,特异性为47.4%.
- 人工智能查速度是人类查速度的四倍,在两次运行之间达成95.4%的一致性.
结论:
- 人工智能越来越多地成为系统审查和元分析的组成部分.
- 了解人工智能的能力和局限性对于伦理研究和基于证据的医疗保健决策至关重要.
相关概念视频
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
Improving Translational Accuracy
3.5K
3.5K
Data Validation
6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
Data Validation
549
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
549
Quality Assurance
929
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
929
