Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Guido Marchi1, Giulia Gambini2, Giacomo Guglielmi3

  • 1UO Pneumologia, Dipartimento Cardio-Toraco-Vascolare, Azienda ospedaliero-universitaria Pisana, Pisa.

Recenti Progressi in Medicina
|October 2, 2025
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The price of immune awakening: bridging knowledge gaps in checkpoint inhibitor-related pneumonitis in lung cancer.

Breathe (Sheffield, England)·2026
Same author

Pulmonary Embolism in Patients with Lung Cancer: Incidence and Performance of Prognostic Markers.

Cancers·2026
Same author

Artificial intelligence for pleural effusion and pneumothorax detection on thoracic ultrasound: an educational viewpoint on the promise, pitfalls and path forward.

Breathe (Sheffield, England)·2026
Same author

Diagnosis and management of interstitial lung disease with concomitant lung cancer in Italy: Results from the ICARO clinician survey.

Multidisciplinary respiratory medicine·2026
Same author

Utility and Safety of Endosonography in the Diagnosis of Small Cell Lung Cancer: A Prospective Single-Center Observational Study.

Diagnostics (Basel, Switzerland)·2026
Same author

Artificial intelligence and radiomics in drug-induced interstitial lung disease.

ERJ open research·2026
Same journal

Recenti progressi in medicina·2026
Same journal

Recenti progressi in medicina·2026
Same journal

Recenti progressi in medicina·2026
Same journal

Recenti progressi in medicina·2026
Same journal

Recenti progressi in medicina·2026
Same journal

Recenti progressi in medicina·2026
See all related articles

Three large language models (LLMs) were tested on Chronic Obstructive Pulmonary Disease (COPD) questions. Gemini 1.5 Advanced excelled in completeness, while Claude 3.5 Sonnet led in accuracy and terminology for COPD patient education.

Area of Science:

  • Artificial Intelligence in Medicine
  • Respiratory Medicine
  • Medical Education Technology

Background:

  • Large language models (LLMs) show potential for medical information dissemination.
  • Accurate and safe patient education is crucial for managing Chronic Obstructive Pulmonary Disease (COPD).
  • Evaluating LLM performance on established clinical guidelines is necessary.

Purpose of the Study:

  • To assess the performance of three leading LLMs (ChatGPT-4, Claude 3.5 Sonnet, Gemini 1.5 Advanced) in answering COPD-related questions.
  • To compare AI-generated responses based on completeness, accuracy, terminology, accessibility, and safety.
  • To evaluate the suitability of LLMs for COPD patient education.

Main Methods:

  • Utilized 61 COPD-related questions derived from GOLD recommendations.

Related Experiment Videos

  • Generated 90 AI responses using ChatGPT-4, Claude 3.5 Sonnet, and Gemini 1.5 Advanced.
  • Evaluated responses by 61 pulmonologists across 6 continents using a standardized rating scale.
  • Main Results:

    • Gemini 1.5 Advanced demonstrated superior completeness in responses.
    • Claude 3.5 Sonnet achieved higher ratings for accuracy and appropriate terminology.
    • No significant differences were observed among the LLMs regarding accessibility and safety.

    Conclusions:

    • LLMs show promise for supporting COPD patient education.
    • Clinical implementation requires careful consideration and further validation for safety and accuracy.
    • Expert review is essential to ensure reliable AI-generated medical information.