Related Experiment Video
Updated: Sep 19, 2025
05:47
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
595
Accuracy and teachability of artificial intelligence chatbots in solving pharmaceutical calculations: a descriptive
Nicole Campbell1, Julie Kalabalik-Hoganson2
1Department of Pharmacy Practice, Fairleigh Dickinson University, Florham Park, NJ, USA. ncampbell@fdu.edu.
International Journal of Clinical Pharmacy
|June 10, 2025
Summary
Artificial intelligence chatbots show limited accuracy in complex pharmaceutical calculations, performing better on simpler tasks. Further evaluation is needed to determine their reliability for pharmacy practice and education.
Area of Science:
- Pharmacy education
- Artificial intelligence in healthcare
Background:
- Pharmaceutical calculations are a core component of Doctor of Pharmacy programs.
- The application of artificial intelligence (AI) chatbots in pharmacy is under exploration.
- The accuracy of AI chatbots for pharmaceutical calculations is not yet established.
Purpose of the Study:
- To assess the accuracy of AI chatbots in performing pharmaceutical calculations.
- To identify potential limitations and areas for improvement in AI chatbot performance for pharmaceutical calculations.
Main Methods:
- Eleven free-access AI chatbots were evaluated.
- A set of 7 faculty-generated pharmaceutical calculation questions were used for testing.
- Performance was assessed based on the proportion of correct responses, error types, and teachability.
Main Results:
- All chatbots correctly answered the oral to intravenous dose conversion question.
- 90.9% correctly answered the control question, and 72.7% correctly calculated the number needed to harm.
- Only 9.1% provided correct antibiotic dosing, and none correctly calculated creatinine clearance, with common errors involving incorrect formulas and weight selection.
Conclusions:
- AI chatbots exhibit limited accuracy in complex, multi-step pharmaceutical calculations.
- AI chatbots may be more reliable for simpler pharmaceutical calculations.
- The teachability of AI chatbots varied, with most showing improvement after correction.
More Related Videos
Related Concept Videos
01:16Non-equilibrium in the Cell
4.9K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.9K
02:05Calculating Equilibrium Concentrations
48.7K
Being able to calculate equilibrium concentrations is essential to many areas of science and technology—for example, in the formulation and dosing of pharmaceutical products. After a drug is ingested or injected, it is typically involved in several chemical equilibria that affect its ultimate concentration in the body system of interest. Knowledge of the quantitative aspects of these equilibria is required to compute a dosage amount that will solicit the desired therapeutic effect.
A more...
A more...
48.7K
02:20The Small x Assumption
46.6K
If a reaction has a small equilibrium constant, the equilibrium position favors the reactants. In such reactions, a negligible change in concentration may occur if the initial concentrations of reactants are high and the Kc value is small. In such circumstances, the equilibrium concentration is approximately equal to its initial concentration. This estimation can be used to simplify the equilibrium calculations by assuming that some equilibrium concentrations are equal to the initial...
46.6K
03:37Uncertainty in Measurement: Accuracy and Precision
82.9K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
82.9K
01:21Fundamental Mathematical Principles in Pharmacokinetics: Calculus and Graphs
2.1K
The fundamental mathematical principles, such as calculus and graphs, play crucial roles in analyzing drug movement and determining pharmacokinetic parameters. Differential calculus examines rates of change and helps to determine the dissolution rate of drugs in biofluids, as well as how drug concentrations change over time. For instance, it can help calculate the rate of elimination of a drug from the body based on its concentration-time profile.
On the other hand, integral calculus focuses on...
On the other hand, integral calculus focuses on...
2.1K
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
184
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
184