Related Experiment Video
Updated: Sep 18, 2025
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
A Comparative Assessment of Large Language Models in Pediatric Dialysis: Reliability, Quality and Readability
Esra Ensari1, Esra Nagehan Akyol Onder2, Pelin Ertan3
1Ministry of Health Antalya City Hospital, Department of Pediatric Nephrology, Antalya, Turkey.
Introduction:
This study evaluated the reliability, quality, and readability of ChatGPT (OpenAI, San Francisco, CA), Gemini (Google, Mountain View, CA), and Copilot (Microsoft Corp., Washington, DC) which are among the most widely used large language models (LLMs) today in answering frequently asked questions (FAQs) related to pediatric dialysis.
Methods:
A total of 45 FAQs were entered into LLM. The Modified DISCERN (mDISCERN) scale assessed reliability; the Global Quality Score (GQS) evaluated quality; and readability was assessed using five metrics: Coleman-Liau Index (CLI), Simple Measure of Gobbledygook (SMOG), Gunning Fog Index (GFI), Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL). Questions were directed to the chat robots twice, on January 25, 2025, and February 1, 2025.
Results:
All three chatbots displayed high reliability, achieving median mDISCERN scores of 5. Quality scores on the GQS were similarly high, with median scores of 5 across platforms; however, Gemini exhibited greater variability (range 1-5) compared to ChatGPT-4o and Copilot (ranges 3-5). Readability scores revealed that chatbot responses were written at an advanced level.
Conclusion:
This study found that LLMs responses to dialysis FAQs were reliable and high quality, but difficult to read; improving readability through expert-reviewed content could increase their impact on public health.
More Related Videos
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
Related Concept Videos
01:25Chronic Kidney Disease I: Introduction
01:28Chronic Kidney Disease III: Interprofessional Care
01:08Renal Drug Clearance: Comparison Between Renal Excretion Methods
Renal clearance is often associated with the renal glomerular filtration rate (GFR), which represents the rate at which plasma is filtered through the glomeruli in the kidney. When drug reabsorption is minimal and there is no active secretion, renal clearance is closely related to the...
01:17Factors Affecting Renal Clearance: Renal Impairment
One condition associated with renal failure is uremia. Uremia is characterized by impaired glomerular filtration and fluid accumulation in the body. This condition hinders the renal clearance of drugs, resulting in drug accumulation and potential...
01:27Dialysis
Acute kidney injury develops suddenly and can be caused by pre-renal causes (e.g., hypovolemia, shock), intrinsic renal causes (e.g., acute tubular necrosis), or post-renal causes (e.g., urinary obstruction). In contrast, chronic renal failure progresses gradually over time and is often...
01:26Pharmacokinetic Models: Comparison and Selection Criterion
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.