Related Experiment Video
Updated: Jun 3, 2025

The Dyspepsia Educational Tool As a Novel Aid in Dyspepsia Management
Published on: June 29, 2019
Utilization of ChatGPT for Rhinology Patient Education: Limitations in a Surgical Sub-Specialty
Alice E Huang1, Michael T Chang1, Ashoke Khanwalkar2
1Department of Otolaryngology-Head and Neck Surgery Stanford University School of Medicine Stanford California USA.
Objective:
To analyze the accuracy of ChatGPT-generated responses to common rhinologic patient questions.
Methods:
Ten common questions from rhinology patients were compiled by a panel of 4 rhinology fellowship-trained surgeons based on clinical patient experience. This panel (Panel 1) developed consensus "expert" responses to each question. Questions were individually posed to ChatGPT (version 3.5) and its responses recorded. ChatGPT-generated responses were individually graded by Panel 1 on a scale of 0 (incorrect) to 3 (correct and exceeding the quality of expert responses). A 2nd panel was given the consensus and ChatGPT responses to each question and asked to guess which response corresponded to which source. They then graded ChatGPT responses using the same criteria as Panel 1. Question-specific and overall mean grades for ChatGPT responses, as well as interclass correlation coefficient (ICC) as a measure of interrater reliability, were calculated.
Results:
The overall mean grade for ChatGPT responses was 1.65/3. For 2 out of 10 questions, ChatGPT responses were equal to or better than expert responses. However, for 8 out of 10 questions, ChatGPT provided responses that were incorrect, false, or incomplete based on mean rater grades. Overall ICC was 0.526, indicating moderate reliability among raters of ChatGPT responses. Reviewers were able to discern ChatGPT from human responses with 97.5% accuracy.
Conclusion:
This preliminary study demonstrates overall near-complete and variably accurate responses provided by ChatGPT to common rhinologic questions, demonstrating important limitations in nuanced subspecialty fields.
More Related Videos
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
09:03Nasal Brushing Sampling and Processing Using Digital High Speed Ciliary Videomicroscopy – Adaptation for the COVID-19 Pandemic
Published on: November 7, 2020
Related Concept Videos
Barriers to Effective Communication II
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Administering Oxygen by Nasal Cannula
Nasal Cannulas
A nasal cannula is a lightweight tube split into two prongs placed in the nostrils,...
Epistaxis
Etiology
Possible causes of this condition include high blood pressure, trauma, low humidity, upper respiratory tract infections, allergies, foreign bodies, nasal inhalation of corticosteroids or illicit drugs, excessive use of decongestant nasal sprays, facial or nasal surgery, anatomic malformation, tumors, or systemic...
Pneumonia V: Nursing management and Prevention
The nurse must practice strict medical asepsis and adhere to infection control guidelines to minimize healthcare-associated infections.
Enhance airway patency
Position the patient correctly to facilitate drainage of the affected lung segments. Manual or mechanical percussion and vibration can also be employed....
Methods of Documentation III: PIE
Pulmonary Function Tests
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...