Related Experiment Videos
Why decision curves cross treat-all and treat-none: A PPV and calibration perspective
1Universitätsspital Basel, Switzerland.
Abstract:
Net benefit is widely used to assess whether clinical prediction models can improve decision-making, but its interpretation is often difficult in practice. In this note, we show how decision curves can be understood through two familiar quantities: positive predictive value and observed event rates in threshold-defined patient groups. We show that a model has positive net benefit compared with treating no one when, among patients classified as positive, the observed event rate exceeds the decision threshold. Similarly, a model outperforms treating everyone when, among patients classified as negative, the observed event rate is below the decision threshold. These results connect decision-curve performance directly to interpretable forms of threshold-specific calibration. We also describe how positive predictive value curves can complement decision curves by showing, at each threshold, the observed event rate among patients selected for action. Together, these perspectives help explain why a prediction model performs better or worse than default strategies and clarify how decision curve comparisons relate to familiar epidemiological quantities.
Related Concept Videos
Calibration Curves: Linear Least Squares
For data that follow a straight line, the standard method for fitting is the linear...
Calibration Curves: Correlation Coefficient
Dose Response Curve: Conventional Versus Nonmonotonic
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Receiver Operating Characteristic Plot
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...