Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Radiological Investigation III: Pulmonary Angiogram and PET Scan01:13

Radiological Investigation III: Pulmonary Angiogram and PET Scan

91
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
91
Radiological Investigation I: X-ray and CT01:30

Radiological Investigation I: X-ray and CT

232
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
232
Radiological Investigation II: MRI and Ventilation Perfusion Scan01:30

Radiological Investigation II: MRI and Ventilation Perfusion Scan

114
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
114
Positron Emission Tomography01:29

Positron Emission Tomography

4.2K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.2K
Pulmonary Tuberculosis IV01:26

Pulmonary Tuberculosis IV

139
Tuberculosis, more commonly referred to as TB, is an infectious disease stemming from Mycobacterium tuberculosis. While it primarily impacts the lungs, TB can also affect other body areas. Given its severity and global impact, timely and accurate diagnosis is crucial for controlling its spread and improving patient outcomes.
Several diagnostic approaches are used to detect TB. The conventional method is the Tuberculin Skin Test (TST), also known as the Mantoux test. However, this method has...
139
Imaging Studies II: Positron Emission Tomography and Scintigraphy01:25

Imaging Studies II: Positron Emission Tomography and Scintigraphy

111
Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET
111
  1. Home
  3. Research Domains
  5. Information And Computing Sciences
  7. Graphics, Augmented Reality And Games
  9. Computer Aided Design
  11. Evaluating Gpt-v4 (gpt-4 With Vision) On Detection Of Radiologic Findings On Chest Radiographs

Evaluating GPT-V4 (GPT-4 with Vision) on Detection of Radiologic Findings on Chest Radiographs

Yiliang Zhou1, Hanley Ong1, Patrick Kennedy1

  • 1From the Departments of Population Health Sciences (Y.Z., Y.P.) and Radiology (H.O., P.K., J.K., K.H., G.S.), Weill Cornell Medicine, 425 E 61st St, Ste 301, New York, NY 10065; Department of Thoracic Imaging, University of Texas MD Anderson Cancer Center, Houston, Tex (C.C.W.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.F.).

Radiology
|May 7, 2024

Related Experiment Videos

Four-Dimensional Computed Tomography-Guided Valve Sizing for Transcatheter Pulmonary Valve Replacement
09:57

Four-Dimensional Computed Tomography-Guided Valve Sizing for Transcatheter Pulmonary Valve Replacement

Published on: January 20, 2022

2.6K
Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer
07:53

Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer

Published on: October 13, 2023

1.4K
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.9K

View abstract on PubMed

Summary
This summary is machine-generated.

Generative pretrained transformer, GPT-4 with vision (GPT-4V), showed limited effectiveness in interpreting real-world chest radiographs for generating radiologic findings. While few-shot learning improved performance, GPT-4V

Area of Science:

  • Artificial intelligence in medical imaging
  • Natural language processing for radiology
  • Computer vision in healthcare

Background:

  • Automated generation of radiologic findings from chest radiographs is crucial for medical image analysis.
  • OpenAI's GPT-4 with vision (GPT-4V) presents potential for automated image-text pair generation.
  • The efficacy of GPT-4V in real-world chest radiography requires thorough investigation.

Purpose of the Study:

  • To evaluate the capability of GPT-4V in generating radiologic findings from real-world chest radiographs.
  • To compare GPT-4V performance against a radiologist-annotated reference standard.
  • To assess performance in both zero-shot and few-shot learning settings.

Main Methods:

  • Retrospective study of 100 chest radiographs from NIH and MIDRC datasets.

Related Experiment Videos

Four-Dimensional Computed Tomography-Guided Valve Sizing for Transcatheter Pulmonary Valve Replacement
09:57

Four-Dimensional Computed Tomography-Guided Valve Sizing for Transcatheter Pulmonary Valve Replacement

Published on: January 20, 2022

2.6K
Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer
07:53

Author Spotlight: Advancing 3D Modeling for Enhanced Diagnosis and Treatment of Pulmonary Nodules in Early-Stage Lung Cancer

Published on: October 13, 2023

1.4K
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.9K
  • Radiologist annotation established a reference standard for clinical conditions and ICD-10 codes with laterality.
  • GPT-4V performance assessed in zero-shot and few-shot settings, compared against the reference standard.

    • Main Results:

    • In zero-shot setting, GPT-4V achieved low performance metrics (e.g., F1 scores of 7.3% on NIH, 18.2% on MIDRC) for ICD-10 code detection.
    • Including laterality further reduced performance (e.g., F1 scores of 4.5% on NIH, 6.4% on MIDRC).
    • Few-shot learning demonstrated improved true-positive rates and F1 scores but not substantial increases in positive predictive value.

    Conclusions:

    • GPT-4V, despite promise in natural image understanding, exhibited limited effectiveness in interpreting real-world chest radiographs.
    • Current performance suggests GPT-4V is not yet suitable for automated generation of radiologic findings from chest X-rays.
    • Further research and model development are needed to enhance AI capabilities in medical image analysis.