Related Experiment Video
Updated: Jul 12, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Using Discrete Form Data in the Electronic Medical Record to Predict the Likelihood of Psychiatric Consultation
Mark A Oldham1, Beth Heaney1, Conrad Gleber2
1Department of Psychiatry, University of Rochester Medical Center, Rochester, NY.
Background:
Manually screening for mental health needs in acute medical-surgical settings is thorough but time-intensive. Automated approaches to screening can enhance efficiency and reliability, but the predictive accuracy of automated screening remains largely unknown.
Objective:
The aims of this project are to develop an automated screening list using discrete form data in the electronic medical record that identify medical inpatients with psychiatric needs and to evaluate its ability to predict the likelihood of psychiatric consultation.
Methods:
An automated screening list was incorporated into an existing manual screening process for 1 year. Screening items were applied to the year's implementation data to determine whether they predicted consultation likelihood. Consultation likelihood was designated high, medium, or low. This prediction model was applied hospital-wide to characterize mental health needs.
Results:
The screening items were derived from nursing screens, orders, and medication and diagnosis groupers. We excluded safety or suicide sitters from the model because all patients with sitters received psychiatric consultation. Area under the receiver operating characteristic curve for the regression model was 84%. The two most predictive items in the model were "3 or more psychiatric diagnoses" (odds ratio 15.7) and "prior suicide attempt" (odds ratio 4.7). The low likelihood category had a negative predictive value of 97.2%; the high likelihood category had a positive predictive value of 46.7%.
Conclusions:
Electronic medical record discrete data elements predict the likelihood of psychiatric consultation. Automated approaches to screening deserve further investigation.
Related Concept Videos
Diagnostic and Statistical Manual of Mental Disorders (DSM)
Methods of Documentation VII: EMR
Documentation of Nursing Diagnosis
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...

