Related Experiment Video
Updated: Jun 13, 2025
Endoscopic Septoplasty with Limited Two-line Resection: Minimally Invasive Surgery for Septal Deviation
Published on: June 20, 2018
Evaluation of Rhinoplasty Information from ChatGPT, Gemini, and Claude for Readability and Accuracy
Monica K Rossi Meyer1, Cherian Kurian Kandathil1, Seth J Davis1
1Division of Facial Plastic and Reconstructive Surgery, Department of Otolaryngology-Head and Neck Surgery, Stanford University School of Medicine, Stanford, CA, USA.
Objective:
Assessment of the readability, accuracy, quality, and completeness of ChatGPT (Open AI, San Francisco, CA), Gemini (Google, Mountain View, CA), and Claude (Anthropic, San Francisco, CA) responses to common questions about rhinoplasty.
Methods:
Ten questions commonly encountered in the senior author's (SPM) rhinoplasty practice were presented to ChatGPT-4, Gemini and Claude. Seven Facial Plastic and Reconstructive Surgeons with experience in rhinoplasty were asked to evaluate these responses for accuracy, quality, completeness, relevance, and use of medical jargon on a Likert scale. The responses were also evaluated using several readability indices.
Results:
ChatGPT achieved significantly higher evaluator scores for accuracy, and overall quality but scored significantly lower on completeness compared to Gemini and Claude. All three chatbot responses to the ten questions were rated as neutral to incomplete. All three chatbots were found to use medical jargon and scored at a college reading level for readability scores.
Conclusions:
Rhinoplasty surgeons should be aware that the medical information found on chatbot platforms is incomplete and still needs to be scrutinized for accuracy. However, the technology does have potential for use in healthcare education by training it on evidence-based recommendations and improving readability.
Level Of Evidence V:
This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Related Concept Videos
01:30Epistaxis
Etiology
Possible causes of this condition include high blood pressure, trauma, low humidity, upper respiratory tract infections, allergies, foreign bodies, nasal inhalation of corticosteroids or illicit drugs, excessive use of decongestant nasal sprays, facial or nasal surgery, anatomic malformation, tumors, or systemic...
01:30Guidelines for Nursing Documentation I
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
01:23Assessment of Respiration
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
01:29Administering Oxygen by Nasal Cannula
Nasal Cannulas
A nasal cannula is a lightweight tube split into two prongs placed in the nostrils,...
01:28Physical Assessment of the Respiratory Tract I: Health History
Subjective Data
Subjective data provides vital information about the patient's health history and symptoms. This data is typically collected through interviews in which patients describe their experiences, symptoms, and concerns.
Health history and...