Related Experiment Video
Updated: Jun 29, 2025
Author Spotlight: Developing a Bedside Protocol for Kidney and Genitourinary Ultrasonography
Published on: June 21, 2024
Poor performance of ChatGPT in clinical rule-guided dose interventions in hospitalized patients with renal
Merel van Nuland1, JaapJan D Snoep2, Toine Egberts3,4
1Department of Clinical Pharmacy, Tergooi Medical Center, Laan van Tergooi 2, 1212 VG, Hilversum, The Netherlands. mvannuland@tergooi.nl.
Purpose:
Clinical decision support systems (CDSS) are used to identify drugs with potential need for dose modification in patients with renal impairment. ChatGPT holds the potential to be integrated in the electronic health record (EHR) system to give such dosing advices. In this study, we aim to evaluate the performance of ChatGPT in clinical rule-guided dose interventions in hospitalized patients with renal impairment.
Methods:
This cross-sectional study was performed at Tergooi Medical Center, the Netherlands. CDSS alerts regarding renal dysfunction were collected from the electronic health record (EHR) during a 2-week period and were presented to ChatGPT and an expert panel. Alerts were presented with and without patient variables. To evaluate the performance, suggested medication interventions were compared.
Results:
In total, 172 CDDS alerts were generated for 80 patients. Indecisive responses by ChatGPT to alerts were excluded. For alerts presented without patient variables, ChatGPT provided "correct and identical" responses to 19.9%, "correct and different" responses to 26.7%, and "incorrect responses to 53.4% of the alerts. For alerts including patient variables, ChatGPT provided "correct and identical" responses to 16.7%, "correct and different" responses to 16.0%, and "incorrect responses to 67.3% of the alerts. Accuracy was better for newer drugs such as direct oral anticoagulants.
Conclusion:
The performance of ChatGPT in clinical rule-guided dose interventions in hospitalized patients with renal dysfunction was poor. Based on these results, we conclude that ChatGPT, in its current state, is not appropriate for automatic integration into our EHR to handle CDSS alerts related to renal dysfunction.
Related Concept Videos
01:11Renal Failure: Dose Adjustments
Reduced renal clearance and elimination rate are common outcomes of renal impairment. These alterations lead to a prolonged elimination half-life and an altered apparent volume of distribution for drugs. As a result, dosage adjustments are typically necessary to maintain optimal drug levels in the body.
However, dosage adjustments...
01:17Factors Affecting Renal Clearance: Renal Impairment
One condition associated with renal failure is uremia. Uremia is characterized by impaired glomerular filtration and fluid accumulation in the body. This condition hinders the renal clearance of drugs, resulting in drug accumulation and potential...
01:06Renal Drug Clearance: Overview
Renal clearance can be calculated using different methods. One approach is to divide the urinary drug excretion rate by the plasma drug concentration. This method directly measures renal clearance, indicating the kidneys' efficiency in...
01:23Renal Clearance
Renal clearance refers to the volume of plasma cleared of a specific substance, such as creatinine, per unit of time. To measure clearance, urine samples are collected over a 24-hour period during each bladder voiding, followed by a single blood sample at the...
01:07Determination of Renal Drug Clearance: Graphical and Midpoint Methods
The graphical method involves plotting the rate of drug excretion in urine against the plasma drug concentration. By analyzing the graph, the clearance can be calculated and obtained. Drugs rapidly excreted by the kidneys exhibit a...
01:28Renal Drug Excretion: Tubular Secretion