Related Experiment Video
Updated: Jan 2, 2026

Competing-Risk Nomogram for Predicting Cancer-Specific Survival in Multiple Primary Colorectal Cancer Patients after Surgery
Published on: September 27, 2024
Are Surrogate Endpoints Unbiased Metrics in Clinical Benefit Scores of the ASCO Value Framework?
Sierra Cheng1, Matthew C Cheung1,2, Di Maria Jiang2
1aOdette Cancer Centre, Sunnybrook Health Sciences Centre, and.
Insights
Clinical benefit scores (CBS) calculated using surrogate endpoints like progression-free survival (PFS) or response rate (RR) tend to overestimate actual benefit compared to overall survival (OS) data. These surrogate-derived scores are biased and poorly correlated with OS-derived scores in oncology drug evaluations.
Area of Science:
- Oncology
- Clinical Trial Analysis
- Health Economics
Background:
- Clinical Benefit Scores (CBS) are integral to the ASCO Value Framework (ASCO-VF).
- CBS are weighted by efficacy endpoints: hazard ratio for death (HR OS), median overall survival (mOS), HR for disease progression (HR PFS), median progression-free survival (mPFS), and response rate (RR).
- When HR OS is unavailable, other endpoints act as surrogates for calculating CBS, used in 39.6% of trials.
Purpose of the Study:
- To evaluate if surrogate-derived CBS provide unbiased scoring compared to HR OS-derived CBS.
- To assess the tendency of surrogate-derived CBS to overestimate or underestimate clinical benefit.
- To examine the correlation between surrogate- and HR OS-derived CBS.
Main Methods:
- Computed CBS for oncology drugs approved by FDA, EMA, and Health Canada (2006-2017) using the ASCO-VF.
- Calculated mean differences between surrogate-derived and HR OS-derived CBS.
- Assessed correlation using Spearman's correlation and average difference using mean absolute error.
Main Results:
- CBS derived from mOS, HR PFS, mPFS, and RR overestimated HR OS-derived CBS by 5.62, 6.86, 29.81, and 3.58, respectively.
- Correlation coefficients between surrogate- and HR OS-derived CBS were 0.80 (mOS), 0.38 (HR PFS), 0.20 (mPFS), and 0.01 (RR).
- Mean absolute errors were 11.32 (mOS), 12.34 (HR PFS), 40.40 (mPFS), and 18.63 (RR).
Conclusions:
- HR PFS-, mPFS-, and RR-derived CBS are suboptimal surrogates due to bias and poor correlation with HR OS-derived CBS.
- PFS, despite lower weighting, overestimated CBS within the ASCO-VF.
- Rescaling surrogate endpoints may not enhance their validity in the ASCO-VF due to poor correlation with HR OS-derived CBS.
Background:
Clinical benefit scores (CBS) are key elements of the ASCO Value Framework (ASCO-VF) and are weighted based on a hierarchy of efficacy endpoints: hazard ratio for death (HR OS), median overall survival (mOS), HR for disease progression (HR PFS), median progression-free survival (mPFS), and response rate (RR). When HR OS is unavailable, the other endpoints serve as "surrogates" to calculate CBS. CBS are computed from PFS or RR in 39.6% of randomized controlled trials. This study examined whether surrogate-derived CBS offer unbiased scoring compared with HR OS-derived CBS.
Methods:
Using the ASCO-VF, CBS for advanced disease settings were computed for randomized controlled trials of oncology drug approvals by the FDA, European Medicines Agency, and Health Canada in January 2006 through December 2017. Mean differences of surrogate-derived CBS minus HR OS-derived CBS assessed the tendency of surrogate-derived CBS to overestimate or underestimate clinical benefit. Spearman's correlation evaluated the association between surrogate- and HR OS-derived CBS. Mean absolute error assessed the average difference between surrogate-derived CBS relative to HR OS-derived CBS.
Results:
CBS derived from mOS, HR PFS, mPFS, and RR overestimated HR OS-derived CBS in 58%, 68%, 77%, and 55% of pairs and overall by an average of 5.62 (n=90), 6.86 (n=110), 29.81 (n=101), and 3.58 (n=108), respectively. Correlation coefficients were 0.80 (95% CI, 0.70-0.86), 0.38 (0.20-0.53), 0.20 (0.00-0.38), and 0.01 (-0.18 to 0.19) for mOS-, HR PFS-, mPFS-, and RR-derived CBS, respectively, and mean absolute errors were 11.32, 12.34, 40.40, and 18.63, respectively.
Conclusions:
Based on the ASCO-VF algorithm, HR PFS-, mPFS-, and RR-derived CBS are suboptimal surrogates, because they were shown to be biased and poorly correlated to HR OS-derived CBS. Despite lower weighting than OS in the ASCO-VF algorithm, PFS still overestimated CBS. Simple rescaling of surrogate endpoints may not improve their validity within the ASCO-VF given their poor correlations with HR OS-derived CBS.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Kaplan-Meier Approach
Cancer Survival Analysis
Bioequivalence Data: Statistical Interpretation
Bioequivalence: Overview
Bioequivalence studies: Biowaivers

