Related Experiment Video
Updated: Jun 12, 2026

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Predicting transition to psychiatric disorders in clinical high-risk for psychosis subjects using machine learning
Alexandre Andrade Loch1, Felipe Heron Queluz2, Bruno Waurzenczak2
1Laboratório de Neurociencias (LIM 27), Instituto de Psiquiatria, Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil; Instituto Nacional de Biomarcadores em Neuropsiquiatria (INBION), Conselho Nacional de Desenvolvimento Científico e Tecnológico, Brazil.
Background:
Clinical-high-risk for psychosis (CHR) status is increasingly viewed as a transdiagnostic risk state, but scalable markers of adverse outcomes remain limited. We tested whether facial dynamics extracted from baseline videos could predict transition to any psychiatric disorder in CHR individuals.
Methods:
In the SSAPP cohort, CHR participants were assessed at baseline with SIPS and SCID-5 and followed for a mean of 22.8 months. Baseline videos from 50 participants were analyzed. Facial landmarks and Action Units were extracted with OpenFace 2.0 from Subject Overview (SO) and Memory Recall (MR) recordings. PCA-derived features and AU summaries were entered into class-weighted logistic-regression models using leave-one-out cross-validation.
Results:
Of the modelled sample, 29 participants transitioned to a psychiatric disorder, including 9 psychotic and 20 non-psychotic outcomes; 21 did not transition. PCA features from SO videos showed the best performance (F1-score = 72%, sensitivity = 66%, specificity = 76%, balanced accuracy = 71%, MCC = 0.41), outperforming MR-derived and AU-based models. Sensitivity was higher for psychotic transitioners (78%) than for non-psychotic transitioners (60%). Predictive signal was concentrated in higher-order PCA components reflecting subtle facial-motor variation.
Conclusions:
Facial dynamics extracted from clinical videos may provide scalable markers of adverse outcomes in CHR populations. Future studies should aim at larger samples and external validation.
More Related Videos
05:52Handwriting Analysis Indicates Spontaneous Dyskinesias in Neuroleptic Naïve Adolescents at High Risk for Psychosis
Published on: November 21, 2013
13:08Measurement of Fronto-limbic Activity Using an Emotional Oddball Task in Children with Familial High Risk for Schizophrenia
Published on: December 2, 2015