Related Experiment Video
Updated: May 21, 2026

A Method for Investigating Change Blindness in Pigeons (Columba Livia)
Published on: September 7, 2018
Unplanned adaptations before breaking the blind
Martin Posch1, Michael A Proschan
1European Medicines Agency, 7 Westferry Circus, E14 4HB London, UK. Martin.Posch@ema.europa.eu
Abstract:
Occasionally, things go so wrong in a clinical trial that a change must be made. For example, the originally planned primary outcome may be measured completely unreliably. Is there any recourse? One may still be able to salvage the trial using a permutation test if a change is made before breaking the treatment blind. The solution is not a panacea; we discuss the limitations and legitimate grounds for criticism. Still, when it is needed, the procedure is preferable to rigid adherence to a design that makes no sense. Published 2012. This article is a US Government work and is in the public domain in the USA.
Insights
When clinical trial primary outcomes are unreliable, a permutation test can salvage the study if applied before treatment unblinding. This method offers a pragmatic solution, despite potential criticisms.
Area of Science:
- Clinical Trials
- Biostatistics
- Statistical Methods
Background:
- Clinical trials may encounter unforeseen issues with primary outcome measurement reliability.
- Rigid adherence to flawed trial designs can compromise study integrity and results.
Purpose of the Study:
- To explore the utility of permutation tests for salvaging clinical trials with unreliable primary outcomes.
- To evaluate the feasibility and limitations of modifying trial procedures mid-study.
Main Methods:
- The study proposes using a permutation test.
- This statistical method is suggested as a recourse when primary outcome measures are unreliable.
- The critical timing for implementation is before breaking the treatment blind.
Main Results:
- Permutation tests can provide a viable alternative to abandoning a flawed clinical trial.
- This approach allows for study salvage under specific, pre-defined conditions.
Conclusions:
- Modifying trial procedures, such as employing permutation tests, can be preferable to maintaining a nonsensical design.
- While not a perfect solution, this method offers a pragmatic approach to address critical issues in clinical trial execution.
Related Concept Videos
Neuroplasticity
Schemas
Blind Procedures
Limits to Natural Selection
Adaptations that Reduce Water Loss
Natural Selection and Adaptation
Beyond physical adaptations, psychological...

