Related Experiment Video
Updated: Apr 1, 2026

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
Published on: January 31, 2014
Adaptive Designs with Discrete Test Statistics and Consideration of Overrunning
R Schmidt1, B Burkhardt, A Faldum
1Rene Schmidt, Institute of Biostatistics and Clinical Research, University of Muenster, Schmeddingstr. 56, 48149 Muenster, Germany.
Background:
Interim analyses are used in clinical trials in order to enable early decisions for medical, ethical, and economic reasons. However, it appears unfeasible to stop a trial during such an interim analysis. New patients will thus enter the trial while the interim analysis is ongoing. Moreover, depending on the event kinetics of the specific disease, the trial design, and the corresponding endpoints, some patients might still be unevaluable at the interim analysis due to not yet completed follow-up. Occurrence of these types of patients is characteristic for sequentially analyzed trials. Such patients are referred to as interim patients. In trials with multiple primary endpoints, another type of interim patients occurs. If some but not all null hypotheses can be rejected at the interim analysis, the trial might be continued to a second stage in order to answer the remaining questions. These second stage patients, however, provide new data to all trial questions including the already rejected ones and thus formally act as interim patients regarding the already rejected null hypotheses. Although all kinds of interim patients are not part of the interim analysis, the data collected on those patients have to be sent to the office of regulatory affairs and will be analyzed. If a smaller or contrasting treatment effect is observed in interim patients, this might lead to a withdrawal of an earlier superiority proof.
Objectives:
Presently, interim patients and their data are usually not considered in the confirmatory test. We offer a strategy to deal with interim patients in sequentially analyzed trials with discrete test statistics. The method covers sequentially analyzed single- and multi-arm trials with one or multiple primary endpoints.
Methods:
When planning adaptive designs, it is common practice to assume that the stage-wise p-values are independent and standard uniformly distributed under the null hypothesis. In the context of discrete test statistics, this implies conservative tests. We provide an algorithm which iteratively optimizes an initially given design while adjusting for both discreteness of test statistics and interim patients. The algorithm is described verbally, graphically and formally to facilitate immediate implementation in computer software.
Results:
The optimized design exploits the aspired significance level better and is more powerful than the initial one. The algorithm applies to fixed sample and planned flexible adaptive designs for single- and multi-arm trials with one or multiple primary endpoints. The benefit increases with the number of interim patients.
Conclusions:
When planning a trial with interim analyses, the rules for decisions must be adjusted to interim patients. Otherwise, the test procedure is conservative resulting in loss of power. This is essential in situations where the number of interim patients is important compared to the first stage, particularly in trials with multiple primary endpoints.
Related Concept Videos
Methods of Medium Optimization
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Experimental Designs
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...

