A proxy measure of clinical insight in psychosis: an electronic health records-based validation study

Insight assessment in psychosis remains challenging in practice-oriented research.

To develop and validate a proxy measure for insight based on information from electronic health records (EHR). For that purpose, we used data on the Scale to Assess Unawareness of Mental Disorder (SUMD) and data from EHR notes of patients in an early psychosis intervention programme (Programa de Atención a Fases Iniciales de Psicosis, Santander, Spain).

Junior and senior clinicians examined 134 clinical notes from 106 patients to explore criterion and content validity between SUMD and a clinician-rated proxy measure, using three SUMD items.

In terms of criterion validity, SUMD scores correlated with the proxy (r = 0.61, P < 0.001), even after adjusting for the following confounders: type of psychotic disorder, clinical remission status and rater experience (r = 0.58, P < 0.001); and the proxy predicted good insight status (odds ratio 20.95, 95% CI 7.32-59.91, P < 0.001). Regarding content validity, the three main SUMD subscores correlated with the proxy (r = 0.55-0.60, P < 0.005). There were no significant differences in age, gender or other clinical variables, i.e. discriminant validity, and the proxy significantly correlated with validated psychometric instruments, i.e. external validity. Intraclass correlation coefficient (i.e. interrater reliability) was 0.88 (95% CI 0.59-1.00, P < 0.05).

This SUMD-based proxy measure was shown to have good to excellent validity and reliability, which may offer a reliable and efficient alternative for assessing insight in real-world clinical practice, EHR-based research and management. Future studies should explore its applicability across different healthcare contexts and its potential for automation, using natural language-processing techniques.