Related Experiment Video
Updated: Jan 8, 2026
05:47
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
1.2K
Accelerating the pace and accuracy of systematic reviews using AI: a validation study.
Jiada Zhan1, Kara Suvada2, Muwu Xu3
1Nutrition and Health Sciences, Laney Graduate School, Emory University, Atlanta, GA, USA. jzha832@emory.edu.
Systematic Reviews
|December 19, 2025
Summary
Artificial intelligence (AI) significantly improves efficiency in systematic reviews, screening titles/abstracts and full-text articles faster than humans. While AI shows high accuracy in initial screening, its performance in full-text review requires careful consideration.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Systematic Review Methodology
Background:
- Artificial intelligence (AI) offers potential efficiency gains in systematic literature reviews and meta-analyses.
- The accuracy of AI tools in screening titles/abstracts and full-text articles remains uncertain.
Purpose of the Study:
- To evaluate the performance metrics of a GPT-4 AI program, Review Copilot.
- To compare AI performance against human decisions (gold standard) in screening systematic review articles.
Main Methods:
- Utilized participant data from four published systematic reviews/meta-analyses.
- Compared Review Copilot's sensitivity and specificity against human screening of titles/abstracts and full-text articles.
- Analyzed screening time, agreement between runs, and kappa statistics.
Main Results:
- Review Copilot achieved 99.2% sensitivity and 83.6% specificity for title/abstract screening.
- Full-text screening sensitivity was 97.6%, with 47.4% specificity.
- AI screening was four times faster than human screening, with 95.4% agreement between runs.
Conclusions:
- AI is increasingly integral to systematic reviews and meta-analyses.
- Understanding AI's capabilities and limitations is crucial for ethical research and evidence-based healthcare decisions.
Related Concept Videos
02:07Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
02:07Improving Translational Accuracy
3.5K
3.5K
01:03Data Validation
6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
01:15Data Validation
549
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
549
01:19Quality Assurance
929
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
929