Related Experiment Video
Updated: Jul 10, 2026

The WATCHMAN Left Atrial Appendage Closure Device for Atrial Fibrillation
Published on: February 28, 2012
Comparative Readability Analysis of AI-Generated Versus Evidence-Based Educational Content on Atrial Fibrillation
Thejas Swaroop Konduru1, Sharada Medapuram Belagu2, Areefa Momtaz3
1Acute Internal Medicine, Midland Metropolitan University Hospital, Sandwell and West Birmingham NHS Trust, West Midlands, GBR.
Insights
ChatGPT offers concise medical summaries comparable to UpToDate in readability but uses more complex vocabulary. This artificial intelligence tool shows promise for clinical education but requires expert validation before integration.
Area of Science:
- Medical Education
- Artificial Intelligence in Healthcare
- Clinical Decision Support
Background:
- Atrial fibrillation (AF) is a common arrhythmia with significant healthcare implications.
- Effective clinical decision-making for AF requires accessible, up-to-date educational content.
- Existing resources like UpToDate can be time-consuming for busy clinicians.
Purpose of the Study:
- To compare the readability and characteristics of educational content generated by ChatGPT-3.5 against UpToDate.
- To assess the suitability of AI-generated medical summaries for professional education.
Main Methods:
- A cross-sectional study comparing ChatGPT-3.5 and UpToDate content on AF.
- Readability assessed using Flesch-Kincaid, SMOG, word count, sentence length, and difficult word percentage.
- Statistical analysis performed using the Mann-Whitney U test.
Main Results:
- ChatGPT content was significantly shorter (median 495 vs. 3381 words) and had shorter sentences (14.3 vs. 19.3 words).
- ChatGPT content exhibited a higher percentage of difficult words (29.6% vs. 23.3%).
- Other readability metrics showed no statistically significant differences.
Conclusions:
- ChatGPT provides concise educational content with comparable readability to UpToDate.
- AI-generated content may contain a higher proportion of complex vocabulary.
- ChatGPT shows potential as a supplementary educational resource, pending expert review and validation.
Abstract:
Introduction Atrial fibrillation (AF) is the most common sustained arrhythmia and is associated with increased risks of stroke, heart failure, and healthcare burden. Access to clear and up-to-date educational content is essential for effective decision-making in complex cases such as AF. Evidence-based resources like UpToDate are often time-consuming to read, and clinicians frequently face time constraints in fast-paced clinical settings. With the growing role of artificial intelligence in healthcare, tools like ChatGPT-3.5 (OpenAI, San Francisco, CA, USA) offer fast and accessible medical summaries. However, their suitability in professional education remains inadequately studied, particularly in comparison with evidence-based resources like UpToDate. Methodology A cross-sectional study was conducted in June 2025. Educational content was generated using ChatGPT-3.5 based on structured prompts and retrieved from UpToDate. Non-textual elements were excluded. Readability was assessed using the Flesch-Kincaid Reading Ease (FRE) score, the Flesch-Kincaid Grade Level (FKGL), the Simple Measure of Gobbledygook (SMOG) Index, word count, sentence count, average words per sentence, and both count and percentage of difficult words. Statistical comparison was done using the Mann-Whitney U test (p < 0.05), analysed with R software (v4.3.2; R Foundation for Statistical Computing, Vienna, Austria). Results ChatGPT content was significantly shorter (median 495 vs. 3381 words; p = 0.029), had shorter sentences (14.3 vs. 19.3 words; p = 0.029), but a higher percentage of difficult words (29.6% vs. 23.3%; p = 0.029). Other differences were not statistically significant. Conclusions ChatGPT provides concise educational content with readability scores comparable to UpToDate but with a higher proportion of complex vocabulary. While promising as a supplementary resource, its integration into clinical decision-making should be guided by expert review and validation.
More Related Videos
Related Concept Videos
Assessment of apical pulse
Assessing the apical pulse is a critical nursing procedure, particularly indicated for:
Health Literacy
Pre-Procedural Guidelines for Assessing Blood Pressure
Antiarrhythmic Drugs: Class II Agents as β-Adrenergic Blockers
Cardiovascular Drugs: Classification based on Therapeutic Indications
Imbalances in Cardiac Output
CHF can occur due to the failure of either side of the heart. Left-side failure leads to pulmonary congestion—the right side continues to send blood...

