Related Experiment Video
Updated: Oct 15, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Development, Validation, and Assessment of Clinical Impact of Real-time Alerts to Detect Inpatient As-Needed Opioid
Elsie Rizk1, Joshua T Swan1,2
1Department of Pharmacy, Houston Methodist, Houston, TX, United States.
Background:
As-needed (PRN) opioid orders with duplicate indications can lead to medication errors and opioid-related adverse drug events.
Objective:
The objective of our study was to build and validate real-time alerts that detect duplicate PRN opioid orders and assist clinicians in optimizing the safety of opioid orders.
Methods:
This single-center, prospective study used an iterative, 3-step process to refine alert performance by advancing from small sample evaluations of positive predictive values (PPVs) (step 1) through intensive evaluations of accuracy (step 2) to evaluations of clinical impact (step 3). Validation cohorts were randomly sampled from eligible patients for each step.
Results:
During step 1, the PPV was 100% (one-sided, 97.5% CI 70%-100%) for moderate and severe pain alerts. During step 2, duplication of 1 or more PRN opioid orders was identified for 17% (34/201; 95% CI, 12%-23%) of patients during chart review. This bundle of alerts showed 94% sensitivity (95% CI 80%-99%) and 96% specificity (95% CI 92%-98%) for identifying patients who had duplicate PRN opioid orders. During step 3, at least 1 intervention was made to the medication profile for 77% (46/60; 95% CI 64%-87%) of patients, and at least 1 inappropriate duplicate PRN opioid order was discontinued for 53% (32/60; 95% CI 40%-66%) of patients.
Conclusions:
The bundle of alerts developed in this study was validated against chart review by a pharmacist and identified patients who benefited from medication safety interventions to optimize PRN opioid orders.
Related Concept Videos
Pharmacovigilance
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
Opioid Analgesics: Synthetic and Semisynthetic Opioids
Analgesia and Pain Management
Therapeutic Drug Monitoring: Affecting Factors
Prescription, Nonprescription and Orphan Drugs
The misuse and addiction to prescription drugs is a growing problem that can affect people of all age groups, specifically teenagers. This can happen when prescription medications are used in ways not intended by the prescriber, such as taking someone else's prescription or using medication for...
Dosage Regimens: Designs and Approaches

