Large language model as clinical decision support system augments medication safety in 16 clinical specialties
View abstract on PubMed
Summary
This summary is machine-generated.Large language models (LLMs) show promise in healthcare, acting as a co-pilot with pharmacists to detect prescribing errors. This AI-assisted approach significantly improved accuracy in identifying high-harm medication errors.
Area Of Science
- Medical Informatics
- Artificial Intelligence in Healthcare
- Clinical Decision Support Systems
Background
- Large language models (LLMs) are increasingly explored for healthcare applications, including task automation and clinical decision support.
- Traditional rule-based alert systems have limitations in identifying complex prescribing errors.
Purpose Of The Study
- To evaluate large language models (LLMs) as an alternative to rule-based alert systems for detecting prescribing errors.
- To compare the performance of LLM-based clinical decision support systems (CDSS) against traditional pharmacist review.
Main Methods
- A prospective, cross-over, open-label study design was employed.
- Ninety-one prescribing error scenarios from 40 clinical vignettes across 16 specialties were used.
- Five LLM models were developed using a retrieval-augmented generation framework and evaluated in three implementation strategies: LLM-CDSS alone, pharmacist + LLM-CDSS (co-pilot), and pharmacist alone.
Main Results
- The co-pilot strategy (pharmacist plus LLM-CDSS) achieved the highest performance with 61% accuracy (precision 0.57, recall 0.61, F1 0.59).
- The co-pilot mode demonstrated a 1.5-fold increase in accuracy for detecting errors posing serious harm compared to pharmacist review alone.
- LLM integration enhanced overall performance in medication chart reviews.
Conclusions
- LLM integration, particularly in a co-pilot model with pharmacists, can significantly enhance the detection of prescribing errors.
- This approach holds potential for improving healthcare professional performance and patient safety in medication management.
- LLMs offer a viable alternative and enhancement to traditional rule-based alert systems in clinical settings.
Related Concept Videos
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
Efficient Information Management: NCIS is designed to manage patient information efficiently, making it easily accessible to...
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Clearance measures drug elimination from the central compartment, including plasma and highly perfused organs like kidneys and liver. Its calculation varies depending on pharmacokinetic models and administration routes. The one-compartment model, for instance, portrays the pharmacokinetics of polar drugs such as aminoglycoside antibiotics administered intravenously and readily excreted in urine. In this case, clearance is influenced by the terminal rate constant (λz) and the total volume...
Pharmacokinetic models utilize mathematical analysis to achieve a detailed quantitative understanding of a drug's life cycle within the body. They are instrumental in simulating a drug's pharmacokinetic parameters, predicting drug concentrations over time, optimizing dosage regimens, linking concentrations with pharmacologic activity, and estimating potential toxicity.
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
The advent of drug therapy has profoundly shaped modern mental health care, providing targeted treatments for a range of psychological disorders. Psychotherapeutic drugs, classified into antianxiety, antidepressant, and antipsychotic medications, address symptoms across anxiety disorders, mood disorders, and schizophrenia. While these medications have transformed patient outcomes, they require careful management due to their potential side effects and limitations.
Antianxiety Medications

