Comparative Readability Analysis of AI-Generated Versus Evidence-Based Educational Content on Atrial Fibrillation

Thejas Swaroop Konduru1, Sharada Medapuram Belagu2, Areefa Momtaz3

  • 1Acute Internal Medicine, Midland Metropolitan University Hospital, Sandwell and West Birmingham NHS Trust, West Midlands, GBR.

Cureus
|October 10, 2025
PubMed

Insights

ChatGPT offers concise medical summaries comparable to UpToDate in readability but uses more complex vocabulary. This artificial intelligence tool shows promise for clinical education but requires expert validation before integration.

Area of Science:

  • Medical Education
  • Artificial Intelligence in Healthcare
  • Clinical Decision Support

Background:

  • Atrial fibrillation (AF) is a common arrhythmia with significant healthcare implications.
  • Effective clinical decision-making for AF requires accessible, up-to-date educational content.
  • Existing resources like UpToDate can be time-consuming for busy clinicians.

Purpose of the Study:

  • To compare the readability and characteristics of educational content generated by ChatGPT-3.5 against UpToDate.
  • To assess the suitability of AI-generated medical summaries for professional education.

Main Methods:

  • A cross-sectional study comparing ChatGPT-3.5 and UpToDate content on AF.
  • Readability assessed using Flesch-Kincaid, SMOG, word count, sentence length, and difficult word percentage.
  • Statistical analysis performed using the Mann-Whitney U test.

Main Results:

  • ChatGPT content was significantly shorter (median 495 vs. 3381 words) and had shorter sentences (14.3 vs. 19.3 words).
  • ChatGPT content exhibited a higher percentage of difficult words (29.6% vs. 23.3%).
  • Other readability metrics showed no statistically significant differences.

Conclusions:

  • ChatGPT provides concise educational content with comparable readability to UpToDate.
  • AI-generated content may contain a higher proportion of complex vocabulary.
  • ChatGPT shows potential as a supplementary educational resource, pending expert review and validation.

Related Concept Videos

Assessment of apical pulse01:17

Assessment of apical pulse

Assessing the Apical Pulse
Assessing the apical pulse is a critical nursing procedure, particularly indicated for:
Health Literacy01:21

Health Literacy

Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative programs,...
Pre-Procedural Guidelines for Assessing Blood Pressure01:10

Pre-Procedural Guidelines for Assessing Blood Pressure

Accurate blood pressure assessment is crucial for diagnosing and managing various health conditions. To ensure the reliability of these measurements, healthcare professionals must adhere to standardized pre-procedural guidelines. These guidelines enhance patient safety and improve the overall quality of healthcare. The following steps are essential for obtaining accurate and consistent blood pressure readings, from using the appropriate tools to ensuring effective communication with the patient.
Antiarrhythmic Drugs: Class II Agents as β-Adrenergic Blockers01:24

Antiarrhythmic Drugs: Class II Agents as β-Adrenergic Blockers

Adrenergic stimulation generally impacts cardiac rate and rhythm. Specifically, stimulation of the β-adrenoceptors triggers an increase in intracellular calcium ion influx and pacemaker currents, which may cause arrhythmias. Catecholamines like adrenaline also demonstrate β2-adrenoceptor-mediated hypokalemia, impacting cardiac action potential and disrupting the normal cardiac rhythm. Class II antiarrhythmic drugs are β-adrenoceptor antagonists or β-blockers, which indirectly block calcium...
Cardiovascular Drugs: Classification based on Therapeutic Indications01:18

Cardiovascular Drugs: Classification based on Therapeutic Indications

Cardiovascular diseases, encompassing a range of conditions, can significantly affect the heart's operations and the overall circulatory system. These conditions impair the heart's ability to pump blood, leading to a deficit in oxygen supply to crucial organs. Anomalies in the heart's electrical system, known as arrhythmias, can cause heartbeats to accelerate or slow down. Usually, heart rates increase during physical activity and decrease while resting or sleeping. However, frequent irregular...
Imbalances in Cardiac Output01:26

Imbalances in Cardiac Output

The heart's primary function is to pump blood throughout the body, maintaining a balance between blood sent out (cardiac output) and blood returning (venous return). If this balance is disrupted, it can result in congestive heart failure (CHF), a severe condition where the heart becomes an inefficient pump, leading to inadequate blood circulation.
CHF can occur due to the failure of either side of the heart. Left-side failure leads to pulmonary congestion—the right side continues to send blood...