Are Surrogate Endpoints Unbiased Metrics in Clinical Benefit Scores of the ASCO Value Framework?

Sierra Cheng1, Matthew C Cheung1,2, Di Maria Jiang2

  • 1aOdette Cancer Centre, Sunnybrook Health Sciences Centre, and.

Insights

Clinical benefit scores (CBS) calculated using surrogate endpoints like progression-free survival (PFS) or response rate (RR) tend to overestimate actual benefit compared to overall survival (OS) data. These surrogate-derived scores are biased and poorly correlated with OS-derived scores in oncology drug evaluations.

Area of Science:

  • Oncology
  • Clinical Trial Analysis
  • Health Economics

Background:

  • Clinical Benefit Scores (CBS) are integral to the ASCO Value Framework (ASCO-VF).
  • CBS are weighted by efficacy endpoints: hazard ratio for death (HR OS), median overall survival (mOS), HR for disease progression (HR PFS), median progression-free survival (mPFS), and response rate (RR).
  • When HR OS is unavailable, other endpoints act as surrogates for calculating CBS, used in 39.6% of trials.

Purpose of the Study:

  • To evaluate if surrogate-derived CBS provide unbiased scoring compared to HR OS-derived CBS.
  • To assess the tendency of surrogate-derived CBS to overestimate or underestimate clinical benefit.
  • To examine the correlation between surrogate- and HR OS-derived CBS.

Main Methods:

  • Computed CBS for oncology drugs approved by FDA, EMA, and Health Canada (2006-2017) using the ASCO-VF.
  • Calculated mean differences between surrogate-derived and HR OS-derived CBS.
  • Assessed correlation using Spearman's correlation and average difference using mean absolute error.

Main Results:

  • CBS derived from mOS, HR PFS, mPFS, and RR overestimated HR OS-derived CBS by 5.62, 6.86, 29.81, and 3.58, respectively.
  • Correlation coefficients between surrogate- and HR OS-derived CBS were 0.80 (mOS), 0.38 (HR PFS), 0.20 (mPFS), and 0.01 (RR).
  • Mean absolute errors were 11.32 (mOS), 12.34 (HR PFS), 40.40 (mPFS), and 18.63 (RR).

Conclusions:

  • HR PFS-, mPFS-, and RR-derived CBS are suboptimal surrogates due to bias and poor correlation with HR OS-derived CBS.
  • PFS, despite lower weighting, overestimated CBS within the ASCO-VF.
  • Rescaling surrogate endpoints may not enhance their validity in the ASCO-VF due to poor correlation with HR OS-derived CBS.
Abstract

Related Concept Videos

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
356
Kaplan-Meier Approach01:24

Kaplan-Meier Approach

The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
518
Cancer Survival Analysis01:21

Cancer Survival Analysis

Cancer survival analysis focuses on quantifying and interpreting the time from a key starting point, such as diagnosis or the initiation of treatment, to a specific endpoint, such as remission or death. This analysis provides critical insights into treatment effectiveness and factors that influence patient outcomes, helping to shape clinical decisions and guide prognostic evaluations. A cornerstone of oncology research, survival analysis tackles the challenges of skewed, non-normally...
610
Bioequivalence Data: Statistical Interpretation01:16

Bioequivalence Data: Statistical Interpretation

Body:The statistical interpretation of bioequivalence data is a significant aspect of pharmaceutical research. Bioequivalence refers to the absence of any significant difference in the rate and extent to which the active ingredient in pharmaceutical products becomes available at the site of drug action when administered at the same molar dose under similar conditions. This helps determine if different drug products have similar absorption rates, ensuring their interchangeability.Statistical...
168
Bioequivalence: Overview01:16

Bioequivalence: Overview

Pharmaceutical equivalents, by definition, are drug products with the same active ingredient in the same quantities, encapsulated in identical dosage forms, and intended for the same administration routes. These pharmaceutical equivalents are deemed bioequivalent if the bioavailability of the active entity in the drug preparations is similar. Moreover, pharmaceutical equivalents demonstrating bioequivalence are also regarded as therapeutically equivalent. This means that when used as directed,...
1.6K
Bioequivalence studies: Biowaivers01:13

Bioequivalence studies: Biowaivers

Body:In certain scenarios, in vitro dissolution tests can replace in vivo bioequivalence studies. This is particularly true when a drug product, though available in varying strengths, maintains proportional similarity in its active and inactive ingredients. In such cases, the need for in vivo bioequivalence studies for lower strength variants may be waived, provided dissolution tests and in vivo studies on the highest strength yield satisfactory results.Bioequivalence can be indicated through...
185