Related Experiment Video
Updated: Mar 20, 2026
07:51
Hydra, a Computer-Based Platform for Aiding Clinicians in Cardiovascular Analysis and Diagnosis
Published on: September 26, 2018
8.2K
Assessment of ChatGPT-4.0 versus ChatGPT-Mini in Generating Guideline-Based Hypertension Content
Rômullo José Costa Ataídes1, Marcos Adriano Garcia Campos2, João Vítor Perez de Souza2
1Faculdade de Medicina da Universidade de São Paulo, São Paulo, SP - Brasil.
Arquivos Brasileiros De Cardiologia
|March 18, 2026
Summary
ChatGPT-4.0 showed minor improvements over ChatGPT-Mini in generating hypertension education content, but differences were not statistically significant. ChatGPT-Mini provided more consistent responses, highlighting the need for AI validation in medical education.
Area of Science:
- Artificial Intelligence in Healthcare
- Medical Education Technology
- Natural Language Processing
Background:
- AI language models are increasingly used for patient education materials.
- Concerns exist regarding the accuracy, completeness, and guideline adherence of AI-generated content.
- Evaluating AI performance in medical contexts is crucial.
Purpose of the Study:
- Compare ChatGPT-4.0 and ChatGPT-Mini for generating hypertension education content.
- Assess accuracy, completeness, structural quality (EQIP), response consistency, and guideline alignment.
- Determine the clinical utility of advanced AI models in patient education.
Main Methods:
- 31 standardized hypertension questions posed to ChatGPT-4.0 and ChatGPT-Mini.
- Independent blinded clinician evaluation using modified EQIP scores, accuracy, and completeness scales.
- BERTScore for response consistency and Wilcoxon rank-sum tests for comparisons.
Main Results:
- ChatGPT-4.0 showed slight advantages in accuracy, completeness, and EQIP scores, but differences were small and not statistically significant.
- Effect sizes (Hodges-Lehmann, Cliff's delta) were modest, with 95% CIs crossing zero.
- ChatGPT-Mini demonstrated higher response consistency (BERTScore F1).
Conclusions:
- ChatGPT-4.0 offers marginal improvements over ChatGPT-Mini for hypertension education content.
- The modest effect sizes and non-significant differences emphasize the need for careful AI evaluation.
- Consistent response generation by ChatGPT-Mini and the importance of reporting effect sizes are key takeaways.
Related Concept Videos
01:10Pre-Procedural Guidelines for Assessing Blood Pressure
939
Accurate blood pressure assessment is crucial for diagnosing and managing various health conditions. To ensure the reliability of these measurements, healthcare professionals must adhere to standardized pre-procedural guidelines. These guidelines enhance patient safety and improve the overall quality of healthcare. The following steps are essential for obtaining accurate and consistent blood pressure readings, from using the appropriate tools to ensuring effective communication with the...
939
01:28Chronic Kidney Disease III: Interprofessional Care
586
Chronic kidney disease (CKD) requires collaborative and comprehensive management. CKD progresses through stages and can lead to end-stage kidney disease (ESKD) if untreated. Interprofessional collaboration and patient education are crucial, enabling patients to manage their health and improve their quality of life.Diagnostic approach for chronic kidney diseaseThe diagnosis of CKD primarily focuses on the glomerular filtration rate (GFR), which assesses kidney function by measuring how well...
586
01:27Peripheral Artery Disease III: Interprofessional Care
515
Peripheral Artery Disease (PAD) is characterized by narrowed arteries that diminish blood flow to the extremities. Effective management of PAD requires an interprofessional approach involving various healthcare professionals. The critical aspects of interprofessional care for PAD patients focus on risk factor modification, drug therapy, exercise therapy, nutrition therapy, critical limb ischemia care, and interventional radiology and surgical procedures.The primary treatment goal for PAD...
515
01:30Hypertension III: Clinical Manifestations and Diagnostic Studies
709
Hypertension is asymptomatic and also referred to as the "silent killer" until it progresses to a severe stage or causes target organ disease. Patients may experience symptoms stemming from the strain on blood vessels and tissues in various organs or the heart's increased workload.Physical exams might show no abnormalities other than high blood pressure. Signs of vascular damage, when present, correspond to the organs supplied by the affected vessels, leading to target organ damage. For...
709
01:18Hypertension and Regulation of Blood Pressure
4.7K
Hypertension, the most common cardiovascular disease, is diagnosed through repeated measurements of elevated blood pressure. Its risks, including damage to the kidney, heart, and brain, are directly proportional to blood pressure levels. Starting from 115/75 mm Hg, the risk of cardiovascular disease doubles with each increment of 20/10 mm Hg. The diagnosis relies on blood pressure measurements, not on patient symptoms, as hypertension is often asymptomatic until end-organ damage is imminent or...
4.7K
01:28Hypertension IV: Drug Therapy and Lifestyle Modifications
821
Multiple classes of antihypertensive medications are employed in treating hypertension. The most commonly recommended first-line treatments include:Thiazide Diuretics, such as chlorthalidone, increase sodium and water excretion from the body, reducing blood volume and blood pressure.Angiotensin-converting enzyme inhibitors, like lisinopril, block the conversion of angiotensin I to II, a potent vasoconstrictor lowering blood pressure.Angiotensin II Receptor Blockers (ARBs) prevent angiotensin II...
821