Related Experiment Video
Updated: Sep 10, 2025
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
Readability of Pediatric Otolaryngology Information: Comparing AI-Generated Content With Google Search Results
Jonathan M Carnino1,2, Sanjeev Rampam1,2, Elizabeth M Puyo1,2
1Boston University Chobanian and Avedisian School of Medicine, Boston, Massachusetts, USA.
Objective:
This study evaluates and compares the readability of pediatric otolaryngology patient education materials generated by ChatGPT4o and those retrieved from Google searches. The goal is to determine whether artificial intelligence (AI)-generated content improves accessibility compared to institutionally affiliated online resources.
Study Design:
Cross-sectional readability analysis.
Setting:
Online educational materials focused on pediatric otolaryngology topics.
Methods:
Educational articles covering 10 pediatric otolaryngology conditions were sourced either via Google search or generated using ChatGPT4o. All texts were standardized by removing extraneous formatting. Readability was assessed using six validated metrics: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Gunning-Fog Index, Simple Measure of Gobbledygook (SMOG), Coleman-Liau Index, and Automated Readability Index (ARI). Statistical comparisons were performed using paired t tests or Wilcoxon signed-rank tests to evaluate differences in scores between sources.
Results:
ChatGPT4o-generated content demonstrated significantly higher FKGL, Gunning-Fog, ARI, and SMOG scores and lower FRES scores compared to Google-sourced materials, indicating greater complexity (P < .05). These differences were most pronounced for simpler conditions such as allergic rhinitis and otitis externa. For more complex topics like laryngomalacia and cleft lip and palate, readability scores were not significantly different between the two sources (P > .05).
Conclusion:
ChatGPT4o-generated patient education materials are generally more difficult to read than Google-sourced content, especially for less complex conditions. Given the importance of readability in patient education, AI-generated materials may require further refinement to improve accessibility without compromising accuracy. Enhancing clarity could increase the utility of AI tools for educating parents and caregivers in pediatric otolaryngology.
Related Concept Videos
01:25Glaucoma: Overview
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
02:07Improving Translational Accuracy
01:27Open Angle Glaucoma: Treatment
Drugs such as carbonic anhydrase inhibitors, α2- and...
01:20The Retinoblastoma Gene
The first-ever tumor suppressor gene called Rb was identified in retinoblastoma - a rare eye tumor in children. In inherited forms of the disease, a child inherits one defective copy of the Rb gene, which predisposes them to retinoblastoma. However,...
01:19Respiratory Assessment: Purpose and Indications
Objectives and Importance:
The primary goal of respiratory assessment is to evaluate patients at early risk of clinical deterioration. Since respiratory distress often precedes other signs of declining health, breathing patterns and sounds become a...