Related Experiment Video
Updated: Aug 6, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Using multiple outcomes in intervention studies: improving power while controlling type I errors
1Department of Experimental Psychology, University of Oxford, Oxford, Oxon, OX2 6GG, UK.
Using multiple outcomes in clinical trials can improve efficiency. The Adjust NVar approach controls error rates, offering a better balance of power and type I error than single outcomes for studies with several correlated measures.
Area of Science:
- Biostatistics
- Clinical Trial Design
- Statistical Significance
Background:
- CONSORT guidelines recommend a single primary outcome to minimize false positives.
- Multiple outcomes can be used if the familywise error rate is controlled.
- Controlling error involves specifying a threshold (N) for significant outcomes based on their number and correlation.
Purpose of the Study:
- To explore an alternative to single primary outcomes in intervention studies.
- To develop a method for controlling familywise error rate with multiple outcomes.
- To assess the efficiency of using multiple correlated outcomes versus a single outcome.
Main Methods:
- Simulations used null-hypothesis significance testing with alpha = .05.
- Examined 2-12 outcome measures, correlations from 0 to .8, and effect sizes from 0 to .7.
- Developed the Adjust NVar approach, calculating minimum significant outcomes (MinNSig) to control the familywise error rate at 5%.
Main Results:
- The Adjust NVar approach demonstrated a more efficient trade-off between statistical power and type I error rate.
- This efficiency was observed when using three or more moderately intercorrelated outcome variables.
- Compared to single-outcome studies, Adjust NVar showed improved performance under specific conditions.
Conclusions:
- Employing a suite of moderately correlated outcome measures can be more efficient than a single primary outcome in intervention studies.
- This approach provides internal replication within a study.
- The Adjust NVar method can also be applied to evaluate existing intervention studies.
More Related Videos
07:20Author Spotlight: Repetitive Transcranial Magnetic Stimulation Combined with Movement Observation in Cerebral Palsy
Published on: August 9, 2024
08:36Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
Related Concept Videos
Errors In Hypothesis Tests
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Comparing the Survival Analysis of Two or More Groups
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.