Related Experiment Video
Updated: Jul 16, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
A comparison of large language model versus manual chart review for extraction of data elements from the electronic
Jin Ge1, Michael Li1, Molly B Delk2
1Division of Gastroenterology and Hepatology, Department of Medicine, University of California - San Francisco, San Francisco, CA.
Importance:
Large language models (LLMs) have proven useful for extracting data from publicly available sources, but their uses in clinical settings and with clinical data are unknown.
Objective:
To determine the accuracy of data extraction using "Versa Chat," a chat implementation of the general-purpose OpenAI gpt-35-turbo LLM model, versus manual chart review for hepatocellular carcinoma (HCC) imaging reports.
Design:
We engineered a prompt for the data extraction task of six distinct data elements and input 182 abdominal imaging reports that were also manually tagged. We evaluated performance by calculating accuracy, precision, recall, and F1 scores.
Setting/Participants:
Cross-sectional abdominal imaging reports of patients diagnosed with hepatocellular carcinoma enrolled in the Functional Assessment in Liver Transplantation (FrAILT) study.
More Related Videos
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
07:50A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
Published on: September 20, 2018
Related Concept Videos
Methods of Documentation VII: EMR
Guidelines and Strategies for Safe Computer Charting
Maintain Confidentiality and Security:
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Methods of Documentation IV: Focus Charting
It typically involves three columns for recording information:
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
Purpose of Health Records I
Here's a breakdown of how health records serve these purposes: