Related Experiment Video
Updated: Sep 27, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Identifying complex patients using Adjusted Clinical Groups risk stratification tool
Shelley-Ann M Girwar1, Jozefine C Verloop, Marta Fiocco
1Department of Public Health and Primary Care, Leiden University Medical Centre, Turfmarkt 99, 2511 DP, the Hague, the Netherlands.
Objectives:
To produce an efficient and practically implementable method, based on primary care data exclusively, to identify patients with complex care needs who have problems in several health domains and are experiencing a mismatch of care. The Johns Hopkins ACG System was explored as a tool for identification, using its Aggregated Diagnosis Group (ADG) categories.
Study Design:
Retrospective cross-sectional study using general practitioners' electronic health records combined with hospital data.
Methods:
A prediction model for patients with complex care needs was developed using a primary care population of 105,345 individuals. Dependent variables in the model included age, sex, and the 32 ADGs. The prediction model was externally validated on 30,793 primary care patients. Discrimination and calibrations were assessed by computing C statistics and by visual inspection of the calibration plot, respectively.
Results:
Our model was able to discriminate very well between complex and noncomplex patients (C statistic = 0.9; 95% CI, 0.88-0.92), whereas the calibration plot suggests that the model provides overestimates of complex patients.
Conclusions:
With this study, the ACG System has proven to be a useful tool in the identification of patients with complex care needs in primary care, opening up possibilities for tailored interventions of care management for this complex group of patients. Utilizing ADGs, the prediction model that we developed had a very good discriminatory ability to identify those complex patients. However, the calibrating ability of the model still needs improvement.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Comparing the Survival Analysis of Two or More Groups
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Hazard Ratio
For example, in a clinical trial...
Relative Risk
Actuarial Approach
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...

