Related Experiment Video
Updated: Jun 11, 2025

A Data Integration Workflow to Identify Drug Combinations Targeting Synthetic Lethal Interactions
Published on: May 27, 2021
Evaluating the capability of ChatGPT in predicting drug-drug interactions: Real-world evidence using hospitalized
Ramya Padmavathy Radha Krishnan1, Euniss Hinyo Hung1,2, Megan Ashford2
1Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia.
Abstract:
Drug-drug interactions (DDIs) present a significant health burden, compounded by clinician time constraints and poor patient health literacy. We assessed the ability of ChatGPT (generative artificial intelligence-based large language model) to predict DDIs in a real-world setting. Demographics, diagnoses and prescribed medicines for 120 hospitalized patients were input through three standardized prompts to ChatGPT version 3.5 and compared against pharmacist DDI evaluation to estimate diagnostic accuracy. Area under receiver operating characteristic and inter-rater reliability (Cohen's and Fleiss' kappa coefficients) were calculated. ChatGPT's responses differed based on prompt wording style, with higher sensitivity for prompts mentioning 'drug interaction'. Confusion matrices displayed low true positive and high true negative rates, and there was minimal agreement between ChatGPT and pharmacists (Cohen's kappa values 0.077-0.143). Low sensitivity values suggest a lack of success in identifying DDIs by ChatGPT, and further development is required before it can reliably assess potential DDIs in real-world scenarios.
Related Concept Videos
Analysis of Population Pharmacokinetic Data
Drug-Receptor Interactions
Several parameters, such as the drug's affinity for its receptor and its efficacy, which is its ability to activate the receptor, determine the drug's effect on the tissue....
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
Drug Distribution: Plasma Protein Binding
Protein-protein Interfaces
Physiological Pharmacokinetic Models: Incorporating Hepatic Transporter-Mediated Clearance
A recent model describes pravastatin's hepatobiliary excretion,...

