Adapting power calculations to include a superiority margin: what are the implications?

Area of Science:

• Biostatistics
• Clinical Trial Design
• Medical Research Methodology

Background:

• Traditional power calculations aim to reject the null hypothesis but may not reflect clinical significance.
• Super-superiority margins, rarely used, establish a clinically meaningful threshold for study outcomes.
• The distinction between effect size and minimum clinically significant difference is often blurred in power calculations.

Purpose of the Study:

• To examine the application and implications of super-superiority margins in statistical power calculations for research studies.
• To differentiate between the expected effect size and the minimum clinically significant difference in study design.
• To evaluate the utility of super-superiority margins in assessing the value of future research and ensuring intervention efficacy.

Main Methods:

• Review of the concept of super-superiority margins in statistical power calculations.
• Audit of 30 recent randomized controlled trial power calculations to assess the use of minimal acceptable or expected differences.
• Comparison of hypothesis acceptance/rejection for super-superiority, non-inferiority, equivalence, and standard superiority studies.

Main Results:

• A significant portion of audited power calculations did not clearly define or utilize the minimal acceptable difference or expected difference.
• Super-superiority margins offer a framework to logically position study results within multiple hypothesis testing scenarios.
• The trend towards larger trial sizes and non-inferiority designs may suggest diminishing effectiveness of new interventions.

Conclusions:

• Implementing super-superiority margins in power calculations ensures a pre-defined evaluation of clinical significance.
• This approach can clarify the value of conducting further studies, especially in a post hoc analysis.
• Powering for superiority, using defined margins, can help confirm that new interventions offer genuine clinical benefits.