Related Experiment Video
Updated: Jul 17, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Sample size planning for multiple contrast tests
Anna Pöhlmann1, Frank Konietschke1
1Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Biometry and Clinical Epidemiology, Berlin, Germany.
Abstract:
Sample size calculations for two (independent) samples are well established and applied in (pre-)clinical research. When planning several samples, which is common in, for example, preclinical studies, sample size planning tools based on analysis of variance methods are available. Since the underlying effect sizes of these methods are often hard to interpret and to provide for the sample size planning, we employ multiple contrast test procedures for sample size computations in both parametric (under normality assumption) and nonparametric designs using Steel-type tests. Since the exact distributions of the test statistics are unknown under the alternative and variance heterogeneity, we use approximate solutions. Furthermore, since no closed formula for the sample size is available, we use numerical approximations for their computation. Extensive simulation studies are finally conducted to assess the quality of the approximations. It turns out that the methods are accurate in the sense that the multiple contrast test procedures reach the target power to detect the alternative of interest with the sample size computed. The developed procedures are a valuable tool to plan (pre-)clinical trials with several samples and are easily accessible in publicly available software.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
One-Way ANOVA: Unequal Sample Sizes
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
McNemar's Test

