Related Experiment Video
Updated: Jul 22, 2026

13:04
Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
Sample size calculations in randomised trials: mandatory and mystical
Kenneth F Schulz1, David A Grimes
1Family Health International, PO Box 13950, Research Triangle Park, NC 27709, USA. KSchulz@fhi.org
Lancet (London, England)
|April 13, 2005
Summary
Accurate sample size calculations are crucial for randomized trials. However, methodological rigor and transparent reporting in underpowered trials can still yield valuable, unbiased results, prioritizing quality over precise numbers.
Area of Science:
- Clinical Trials Methodology
- Biostatistics
- Research Ethics
Background:
- Sample size calculations are a standard prerequisite for randomized trials, influencing their perceived ethical standing.
- The determination of effect size in these calculations involves subjective clinical judgments, which significantly impact the required sample size.
- Current practices often lead to trials being labeled unethical based on perceived imprecision in sample size determination.
Purpose of the Study:
- To question the ethical implications of labeling randomized trials as unethical due to imprecise sample size calculations.
- To advocate for a shift in focus from sample size fixation to the importance of methodological quality in research.
- To emphasize the value of unbiased trials, even with imprecise results, over no results.
Main Methods:
- The study critically examines the process and implications of a-priori sample size calculations in randomized trials.
- It analyzes the impact of subjective clinical judgments on effect size determination and its subsequent effect on sample size.
- The authors propose alternative perspectives on evaluating the ethical standing and value of research studies.
Main Results:
- Imprecise sample size calculations should not automatically render a trial unethical.
- Underpowered trials can be ethically acceptable and scientifically valuable if they employ rigorous methodology to minimize bias.
- Prioritizing methodological rigor and transparent reporting is more beneficial than fixating on precise sample sizes.
Conclusions:
- A greater emphasis on methodological quality and bias elimination in randomized trials is recommended.
- Unbiased trial results, even if imprecise, are preferable to the absence of data.
- Clinicians and patients benefit from reliable, unbiased research findings regardless of exact sample size precision.
Related Concept Videos
Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
Random Sampling Method
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
Random Variables
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Sample Size Calculation
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
Wald-Wolfowitz Runs Test II
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...

