Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Randomized Experiments01:13

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Bias01:22

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Blinding01:11

Blinding

Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Factorial Design02:01

Factorial Design

Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs01:20

Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs

Bioequivalence experimental study designs are crucial methodologies used in evaluating and comparing the bioavailability of different drug products. These designs are categorized into various types: completely randomized, randomized block, repeated measures, cross and carry-over, and Latin square designs.Completely randomized designs involve randomly allocating treatments to all subjects participating in the experiment. This allocation is achieved by assigning unique random numbers to subjects...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

SPIRIT 2025 statement: updated guideline for protocols of randomised trials.

Lancet (London, England)·2026
Same author

The CRT-Estimands Framework for Cluster Randomized Trials.

JAMA·2026
Same author

CRT-Estimands Framework: consensus based extension of the ICH E9(R1) addendum for cluster randomised trials.

BMJ (Clinical research ed.)·2026
Same author

Tools to help patients and other stakeholders' input into choice of intercurrent event strategy for estimands in randomised trials.

Trials·2026
Same author

Statistical analysis plan for Fluid Optimisation in Emergency Laparotomy (FLO-ELA) Trial; a multi-centre randomised trial of cardiac output-guided fluid therapy compared to usual care in patients undergoing major emergency gastrointestinal surgery.

Trials·2026
Same author

What Makes an Estimand Useful? Guidance on the Choice of Intercurrent Event Strategies.

Statistics in medicine·2026
Same journal

Interpretable Bayesian Modeling for Multireader Multicase Studies: Addressing Overdispersion and Limited Sample Size in Diagnostic Enhancement Evaluation.

Statistics in medicine·2026
Same journal

Adaptive Sequential Multiple Hypotheses Testing for Concomitant Vaccine Safety Surveillance.

Statistics in medicine·2026
Same journal

Novel Distance Regression for Repeated Outcomes With Missing Data: Applications to Longitudinal and Crossover Studies of Microbiome Beta-Diversity.

Statistics in medicine·2026
Same journal

Optimal Weighted Tests for Replication Studies and the 'Two-Trials Rule' With Multiple Hypotheses.

Statistics in medicine·2026
Same journal

Identifiable Copula-Double-Cox Models: A Fully Parametric Framework for Dependent Right-Censored Survival Data.

Statistics in medicine·2026
Same journal

Moving From Individualized Risk-Based Prevention to Benefit-Based Prevention: Estimating Individualized Life-Years Gained From Prevention Services as a Basis for Eligibility.

Statistics in medicine·2026
See all related articles

Related Experiment Video

Updated: May 10, 2026

Online Repetitive Transcranial Magnetic Stimulation of Dorsomedial and Dorsolateral Prefrontal Cortex in Cognition Decision Making, and Cognitive Dissonance
13:20

Online Repetitive Transcranial Magnetic Stimulation of Dorsomedial and Dorsolateral Prefrontal Cortex in Cognition Decision Making, and Cognitive Dissonance

Published on: December 5, 2025

Bias in randomised factorial trials.

Brennan C Kahan1

  • 1MRC Clinical Trials Unit, Aviation House, 125 Kingsway, London WC2B 6NH, U.K.

Statistics in Medicine
|June 5, 2013
PubMed
Summary
This summary is machine-generated.

The two-stage analysis for factorial trials can produce biased treatment effect estimates and inflated error rates. Researchers should consider multi-arm trials for unbiased results and accurate power calculations.

Keywords:
2 × 2 factorial designfactorial trialspreliminary interaction testrandomised controlled trialtwo-stage analysis

Related Experiment Videos

Last Updated: May 10, 2026

Online Repetitive Transcranial Magnetic Stimulation of Dorsomedial and Dorsolateral Prefrontal Cortex in Cognition Decision Making, and Cognitive Dissonance
13:20

Online Repetitive Transcranial Magnetic Stimulation of Dorsomedial and Dorsolateral Prefrontal Cortex in Cognition Decision Making, and Cognitive Dissonance

Published on: December 5, 2025

Area of Science:

  • Clinical Trials
  • Biostatistics
  • Medical Research Methodology

Background:

  • Factorial trials efficiently assess multiple treatments but assume no interaction between arms.
  • Ignoring treatment interactions can cause biased conclusions in factorial trial analyses.
  • A common two-stage analysis approach assesses interaction significance before proceeding.

Purpose of the Study:

  • To evaluate the validity and potential biases of the two-stage analysis method in factorial trials.
  • To investigate the impact of interaction estimates on treatment effect calculations.
  • To compare the two-stage analysis with alternative trial designs.

Main Methods:

  • Simulations were conducted to assess treatment effect bias under the two-stage analysis.
  • The correlation between interaction estimates and four-arm analysis effects was examined.
  • Type I error rates were evaluated in scenarios with and without true interactions.

Main Results:

  • The two-stage analysis demonstrated significant bias in estimated treatment effects, even without a true interaction.
  • Bias in treatment effects was found to be severe, exceeding 100% in some simulations.
  • Inflated type I error rates were observed due to the biased estimates and correlation issues.

Conclusions:

  • The two-stage analysis is not recommended for factorial trials due to inherent biases and inflated error rates.
  • Multi-arm trials offer a preferable alternative, providing unbiased results and straightforward interpretation.
  • Multi-arm trials allow for accurate power calculations and robust conclusions regardless of treatment interactions.