Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Extraction: Advanced Methods00:56

Extraction: Advanced Methods

1.1K
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
1.1K
Non-equilibrium in the Cell01:16

Non-equilibrium in the Cell

5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cochrane Evaluation of (Semi-) Automated Review Methods (CESAR): Protocol for an adaptive platform study within reviews.

Journal of clinical epidemiology·2026
Same author

Area under the likelihood curve as a measure of evidential weight in nonsignificant meta-analyses: a meta-epidemiological study.

Journal of clinical epidemiology·2026
Same author

Adult Misuse of ADHD Stimulant Medication in the United States: A Rapid Review.

Journal of clinical psychopharmacology·2026
Same author

Assessing the trustworthiness of health guidelines recommendations: the transparent, rigorous, useable, standardized, and trustworthy guide (TRUSTGUIDES) tools development.

Journal of clinical epidemiology·2026
Same author

Quality of hospital medicine care in Veterans Affairs hospitals versus non-Veterans Affairs hospitals: A systematic review of comparative studies.

Journal of hospital medicine·2026
Same author

Evaluating search approaches for a network meta-analysis: a case study of Epistemonikos Database of Trials, CENTRAL, and other sources.

BMC medical research methodology·2026
Same journal

Summary for Patients: Benefits and Harms of Immediate Versus Delayed Treatment of Cervical Intraepithelial Neoplasia Grade 2.

Annals of internal medicine·2026
Same journal

Early Access to GLP-1 Receptor Agonists for Weight Management in Medicare: The GLP-1 Bridge Demonstration.

Annals of internal medicine·2026
Same journal

Annals Graphic Medicine - Stages of Grief Following a Grant Rejection.

Annals of internal medicine·2026
Same journal

Stockholm3-Magnetic Resonance Imaging Population-Based Prostate Cancer Screening Study: Two-Year Follow-up.

Annals of internal medicine·2026
Same journal

Pragmatic Trials: The Importance of Foundational Research, Fidelity, Implementation, and Context.

Annals of internal medicine·2026
Same journal

Expanding Technology-Enabled, Nurse-Delivered Chronic Disease Care : A Pragmatic, Randomized, Effectiveness-Implementation Trial.

Annals of internal medicine·2026
See all related articles
  1. Home
  3. Artificial Intelligence-assisted Data Extraction With A Large Language Model: A Study Within Reviews.
  1. Home
  3. Artificial Intelligence-assisted Data Extraction With A Large Language Model: A Study Within Reviews.

Related Experiment Video

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

1.0K

Artificial Intelligence-Assisted Data Extraction With a Large Language Model: A Study Within Reviews.

Gerald Gartlehner1, Shannon Kugley2, Karen Crotty2

  • 1Social, Statistical, and Environmental Sciences, RTI International, Research Triangle Park, North Carolina, and Department for Evidence-based Medicine and Evaluation, University for Continuing Education Krems, Krems, Austria (G.G.).

Annals of Internal Medicine
|November 3, 2025

View abstract on PubMed

Summary
This summary is machine-generated.

Large language models (LLMs) offer a more efficient alternative for data extraction in evidence synthesis, reducing time and improving accuracy compared to human-only methods. This AI-assisted approach shows promise for streamlining systematic reviews.

More Related Videos

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.3K

Related Experiment Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

1.0K
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.3K

Area of Science:

  • Health Services Research
  • Artificial Intelligence in Healthcare
  • Systematic Review Methodology

Background:

  • Data extraction is crucial for evidence synthesis but is often time-consuming and prone to errors.
  • Large Language Models (LLMs) present a novel AI solution for data extraction, notably without requiring pre-labeled training data.

Purpose of the Study:

  • To compare the efficiency and accuracy of AI-assisted data extraction using LLMs against traditional human-only methods.
  • To evaluate the performance of LLM-based data extraction within real-world systematic review workflows.

Main Methods:

  • A prospective, parallel-group comparison (Study Within A Review - SWAR) was conducted across 6 ongoing systematic reviews.
  • LLMs (Claude versions 2.1, 3.0 Opus, 3.5 Sonnet) performed initial data extraction, followed by human reviewer verification.
  • Key metrics included concordance, time on task, accuracy, sensitivity, positive predictive value, and error analysis compared to a reference standard.

    • Main Results:

    • The AI-assisted approach demonstrated higher accuracy (91.0%) than human-only extraction (89.0%) and reduced extraction time by a median of 41 minutes per study.
    • Concordance between methods was 77.2%, with AI-assisted extraction showing higher sensitivity (89.4%) and positive predictive value (99.2%).
    • Missed data items were the most frequent error type for both methods, with AI-assisted extraction having slightly lower error rates (9.0% vs. 11.0%).

    Conclusions:

    • AI-assisted data extraction using LLMs provides a viable and more efficient alternative to traditional human-only methods in evidence synthesis.
    • The findings suggest that LLMs can significantly streamline the systematic review process, potentially improving resource allocation and review speed.