Related Experiment Video
Updated: Aug 4, 2026

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Validity of prognostic models: when is a model clinically useful?
Yvonne Vergouwe1, Ewout W Steyerberg, Marinus J C Eijkemans
1Center for Clinical Decision Sciences, Department of Public Health, Erasmus University Rotterdam, The Netherlands.
Abstract:
Prognostic models combine patient characteristics to predict medical outcomes. Unfortunately, such models do not always perform as well for other patients as those from whose data the models were derived. Therefore, validity of prognostic models needs to be assessed in new patients. Predicted probabilities can be calculated with the model and compared with the actually observed outcomes. We may distinguish several aspects of validity: (1) agreement between predicted probabilities and observed probabilities (calibration), (2) ability of the model to distinguish subjects with different outcomes (discrimination), and (3) ability of the model to improve the decision-making process (clinical usefulness). We discuss those aspects and show some measures by using models for testicular and prostate cancer. We conclude that good calibration and discriminative ability are not sufficient for a model to be clinically useful. Application of a prognostic model is sensible, if the model is able to provide useful additional information for clinical decision making.
Related Concept Videos
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Pharmacokinetic Models: Comparison and Selection Criterion
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Impact of Pharmacokinetic–Pharmacodynamic Models: Regulatory Decisions
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Receiver Operating Characteristic Plot
Assumptions of Survival Analysis

