Related Experiment Video
Updated: Aug 23, 2026
Establishment of Rat Models Mimicking Gender-affirming Hormone Therapies
Published on: January 10, 2025
Hypothesis testing in the "gold standard" design for proving the efficacy of an experimental treatment relative to
1Bundesinstitut für Arzneimittel und Medizinprodukte, Kurt Georg Kiesinger Allee, Bonn, Germany. a.koch@bfarm.de
Abstract:
This article reviews the most important reasons to include a placebo and a reference treatment group in a study to investigate the efficacy of a new experimental treatment. We argue that as a general rule the regulatory requirement is the proven superiority of the experimental treatment over placebo and the proven noninferiority of the experimental treatment as compared to the reference treatment. Whether or not the reference treatment can be shown to be superior to placebo may impact the formulation of the indication but should not, per se, question the usefulness of the experimental treatment or the credibility of the principal proof of efficacy. We argue that a mandatory requirement for the reference treatment to be superior to placebo is ill founded and especially difficult to justify in the situation where the experimental treatment can also prove its superiority over the reference treatment. For this latter situation, it is shown that no adjustment for multiple hypothesis testing is needed, if at the same time superiority of the reference over placebo and superiority of the experimental treatment over the reference are investigated.
Related Concept Videos
01:16Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
01:19Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
01:13Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
01:11Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p ≠ 0.5.
01:16Null and Alternative Hypotheses
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the population that is...
01:14Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...