Related Experiment Video
Updated: Sep 10, 2025
12:18
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
7.6K
Accuracy and Safety of ChatGPT-3.5 in Assessing Over-the-Counter Medication Use During Pregnancy: A Descriptive
Bernadette Cornelison1, David R Axon1, Bryan Abbott1
1R. Ken Coit College of Pharmacy, University of Arizona, 1295 N. Martin Ave., Tucson, AZ 85721, USA.
Pharmacy (Basel, Switzerland)
|August 27, 2025
Summary
Artificial intelligence (AI) chatbots like ChatGPT-3.5 show high accuracy and completeness for pregnant patients seeking over-the-counter (OTC) medication advice. However, critical safety errors were found, making AI an unsafe standalone resource for this information.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Healthcare
- Reproductive Health
Background:
- Pregnant individuals increasingly use AI for health information, including over-the-counter (OTC) medication guidance.
- Medication safety during pregnancy is critical, yet data availability is often limited.
- AI chatbots may offer accessible information but require rigorous safety validation.
Purpose of the Study:
- To evaluate the accuracy, completeness, and safety of ChatGPT-3.5 in providing information on OTC medications for pregnant patients.
- To compare AI-generated responses against a trusted medical resource, UpToDate®.
Main Methods:
- A prospective, descriptive study assessed 87 pharmacist-recommended OTC drugs.
- ChatGPT-3.5 responses were compared to UpToDate® information using a 5-point Likert scale by independent reviewers.
- Consensus ratings were established after group discussions, with a third investigator providing final scores.
Main Results:
- ChatGPT-3.5 received high median scores for correctness (5/5) and safety (5/5).
- Completeness received a median score of 4/5.
- Despite high scores, 9% of evaluations (n=8) contained safety errors, including omissions with potential for serious complications.
Conclusions:
- While ChatGPT-3.5 demonstrates strong performance in accuracy and completeness for OTC drug information in pregnancy, safety concerns persist.
- The identified safety errors, particularly omissions, render the chatbot an unsafe standalone resource for pregnant patients.
- Further development and validation are necessary before AI chatbots can be reliably used for medication advice during pregnancy.
More Related Videos
05:33Author Spotlight: Alleviating Nausea and Vomiting in Pregnancy with Safe and Effective Auricular Acupuncture
Published on: August 4, 2023
1.7K
13:35A Convenient Method for Extraction and Analysis with High-Pressure Liquid Chromatography of Catecholamine Neurotransmitters and Their Metabolites
Published on: March 1, 2018
14.8K
Related Concept Videos
01:07Teratogenicity
2.7K
The ability of a drug to produce structural deformations and functional abnormalities in the developing embryo or the fetus is called teratogenicity, and the drug producing this effect is known as a teratogen. Teratogenic effects include stillbirth, miscarriage, intrauterine growth restriction, and neurocognitive delay. A teratogen may affect the embryo at different stages of development, which is important in determining the type and extent of the damage. During blastocyst formation, the early...
2.7K
01:15Drug Dosage Regimen: Overview
3.8K
A drug dosage regimen describes the specific instructions and schedule for administering a drug to a patient. It considers factors such as drug dosage, frequency, route of administration, and duration of treatment. Designing an appropriate dosage regimen for a patient aims to achieve a target drug concentration at the site of action.
Typically, the starting dose and dosing interval are guided by the manufacturer's recommendations based on clinical trials conducted during and after drug...
Typically, the starting dose and dosing interval are guided by the manufacturer's recommendations based on clinical trials conducted during and after drug...
3.8K
01:19Pharmacovigilance
983
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
983
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
174
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
174
01:21Factors Affecting Drug Response: Overview
2.4K
When it comes to infants and young children, they are typically administered smaller doses of medication in comparison to adults. This is primarily because their organ functions still need to fully develop, meaning their bodies are not as efficient at metabolizing or eliminating drugs. Additionally, their blood-brain barrier is more permeable than in adults. As a result, high concentrations of drugs can easily penetrate the central nervous system (CNS), potentially leading to neurological...
2.4K
01:26Drug Administration and Therapy Phases: Overview
738
Drugs, the chemical agents used in diagnosing, treating, or preventing diseases, undergo a four-phase process of development: pharmaceutic, pharmacokinetics, pharmacodynamics, and therapeutic.
The pharmaceutical phase focuses on leveraging the physicochemical properties of the drug to design and manufacture an effective product. Variants include orally administered tablets or capsules, topical creams or ointments, and parenteral-delivery solutions or emulsions.
The pharmacokinetic phase...
The pharmaceutical phase focuses on leveraging the physicochemical properties of the drug to design and manufacture an effective product. Variants include orally administered tablets or capsules, topical creams or ointments, and parenteral-delivery solutions or emulsions.
The pharmacokinetic phase...
738