Related Experiment Video
Updated: Aug 16, 2025

An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
Targeted validation: validating clinical prediction models in their intended population and setting.
Matthew Sperrin1, Richard D Riley2, Gary S Collins3
1Division of Informatics, Imaging and Data Science, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK. matthew.sperrin@manchester.ac.uk.
Targeted validation ensures clinical prediction models perform well in their intended use settings. This approach enhances model applicability and reduces research waste by focusing on relevant datasets.
Area of Science:
- Clinical Epidemiology
- Biostatistics
- Health Informatics
Background:
- Clinical prediction models require rigorous validation for reliable deployment.
- External validation studies often use datasets not representative of the model's intended use population.
- This mismatch can lead to overestimated performance and inappropriate clinical use.
Discussion:
- Introducing "targeted validation" to emphasize performance estimation within the specific intended population and setting.
- Targeted validation sharpens focus on model applicability and relevance.
- Distinguishes between internal and external validation needs based on population overlap.
Key Insights:
- Targeted validation prioritizes relevance over convenience in dataset selection.
- It helps prevent misleading conclusions about model performance.
- Reduces unnecessary research waste by avoiding irrelevant validation efforts.
Outlook:
- Promotes more accurate assessment of clinical prediction model utility.
- May reduce the need for external validation when internal validation is robust and populations match.
- Encourages development of models with greater real-world applicability.
More Related Videos
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
06:55Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Related Concept Videos
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Analysis of Population Pharmacokinetic Data
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Clinical Trials
There are four phases in a clinical trial. A phase one...
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.