Related Experiment Video
Updated: Jun 4, 2025

Improving IV Insulin Administration in a Community Hospital
Published on: June 11, 2012
Comparative evaluation of artificial intelligence systems' accuracy in providing medical drug dosages: A
Swaminathan Ramasubramanian1, Sangeetha Balaji1, Tejashri Kannan1
1Department of Orthopaedics, Government Medical College, Omandurar Government Estate, Chennai 600002, Tamil Nadu, India.
Background:
Medication errors, especially in dosage calculation, pose risks in healthcare. Artificial intelligence (AI) systems like ChatGPT and Google Bard may help reduce errors, but their accuracy in providing medication information remains to be evaluated.
Aim:
To evaluate the accuracy of AI systems (ChatGPT 3.5, ChatGPT 4, Google Bard) in providing drug dosage information per Harrison's Principles of Internal Medicine.
Methods:
A set of natural language queries mimicking real-world medical dosage inquiries was presented to the AI systems. Responses were analyzed using a 3-point Likert scale. The analysis, conducted with Python and its libraries, focused on basic statistics, overall system accuracy, and disease-specific and organ system accuracies.
Results:
ChatGPT 4 outperformed the other systems, showing the highest rate of correct responses (83.77%) and the best overall weighted accuracy (0.6775). Disease-specific accuracy varied notably across systems, with some diseases being accurately recognized, while others demonstrated significant discrepancies. Organ system accuracy also showed variable results, underscoring system-specific strengths and weaknesses.
Conclusion:
ChatGPT 4 demonstrates superior reliability in medical dosage information, yet variations across diseases emphasize the need for ongoing improvements. These results highlight AI's potential in aiding healthcare professionals, urging continuous development for dependable accuracy in critical medical situations.
More Related Videos
Related Concept Videos
Pharmacokinetic Models: Comparison and Selection Criterion
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Factors Affecting Drug Response: Overview
Drug Dosage Regimen: Overview
Typically, the starting dose and dosing interval are guided by the manufacturer's recommendations based on clinical trials conducted during and after drug...
Dosage Regimen: Fixed Dose
Fixed-dose regimens can be used for various routes of administration, including intravenous (IV) injections and oral medications. For IV administration, a predetermined amount of the drug is...
Rational Dosage Regimen: Maintenance Dose and Loading Dose
In most cases, drugs are administered repetitively or infused continuously to maintain a steady-state concentration in the body. At a steady...
Bioequivalence: Overview

