Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Crossover Experiments01:16

Crossover Experiments

Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Group Design02:01

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
Experimental Designs01:16

Experimental Designs

An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
Cochran's Q Test01:17

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
McNemar's Test01:23

McNemar's Test

McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Disruptions in perinatal outcomes across Manitoba, Canada: before and over 2 years of the COVID-19 pandemic.

BMJ paediatrics open·2026
Same author

Multimorbidity patterns among fragility fracture patients aged 50 + years in China and the US.

Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA·2026
Same author

Experiences of racially, ethnically, sexual- and gender-minoritized adolescents and young adults with cancer in the Canadian health care system.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2026
Same author

Enabling the analysis of patient-level data across jurisdictions for research use: a real-world exploration of a federated likelihood approach.

International journal of population data science·2026
Same author

Impact of depression and anxiety on health-related quality of life changes over time within individuals with rheumatoid arthritis or inflammatory bowel disease: A prospective Canadian cohort study.

PloS one·2026
Same author

Effect of time on reperfusion in acute ischemic stroke treated with thrombolysis within the 4.5-hour window: a secondary analysis of the AcT Trial.

Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association·2026
Same journal

Addressing selective reporting bias in meta-analysis of dependent effect sizes: A tutorial in R.

Psychological methods·2026
Same journal

Heterogeneous variance models with Gaussian processes.

Psychological methods·2026
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
See all related articles

Related Experiment Video

Updated: Jun 9, 2026

Repeated Transcranial Magnetic Stimulation Combined with Action Observation Training in Children with Spastic Cerebral Palsy
07:20

Repeated Transcranial Magnetic Stimulation Combined with Action Observation Training in Children with Spastic Cerebral Palsy

Published on: August 9, 2024

Testing multiple outcomes in repeated measures designs.

Lisa M Lix1, Tolulope Sajobi

  • 1School of Public Health, University of Saskatchewan, 107 Wiggins Road, Saskatoon, Saskatchewan, Canada. lisa.lix@usask.ca

Psychological Methods
|September 9, 2010
PubMed
Summary
This summary is machine-generated.

This study evaluated methods for controlling familywise error rates in repeated measures designs. The permutation step-down (PSD) procedure effectively controlled error rates and offered greater power than traditional methods.

More Related Videos

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

A Within-Subject Experimental Design using an Object Location Task in Rats
09:28

A Within-Subject Experimental Design using an Object Location Task in Rats

Published on: May 6, 2021

Related Experiment Videos

Last Updated: Jun 9, 2026

Repeated Transcranial Magnetic Stimulation Combined with Action Observation Training in Children with Spastic Cerebral Palsy
07:20

Repeated Transcranial Magnetic Stimulation Combined with Action Observation Training in Children with Spastic Cerebral Palsy

Published on: August 9, 2024

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design
07:40

Validation of a Psychosocial Intervention on Body Image in Older People: An Experimental Design

Published on: May 31, 2021

A Within-Subject Experimental Design using an Object Location Task in Rats
09:28

A Within-Subject Experimental Design using an Object Location Task in Rats

Published on: May 6, 2021

Area of Science:

  • Psychology
  • Statistics
  • Research Methodology

Background:

  • Repeated measures (RM) designs are common in psychology research.
  • A majority of RM studies test hypotheses involving multiple, correlated outcome variables.
  • Controlling the familywise error rate (FWR) is crucial in such analyses.

Purpose of the Study:

  • To investigate procedures for controlling the FWR in repeated measures (RM) designs with multiple, correlated outcomes.
  • To extend existing multiple testing procedures from 2-group designs to 2-group RM designs.
  • To evaluate the performance of modified Bonferroni and permutation step-down (PSD) procedures.

Main Methods:

  • Content analysis of psychology journal articles to assess current practices in RM research.
  • Monte Carlo simulation study to evaluate FWR, any-variable power, and all-variable power.
  • Implementation of two modified Bonferroni procedures and a permutation step-down (PSD) procedure.

Main Results:

  • One modified Bonferroni procedure led to inflated FWRs.
  • The permutation step-down (PSD) procedure effectively controlled the FWR.
  • The PSD procedure demonstrated higher power compared to the conventional Bonferroni procedure.
  • Power differences between PSD and Hochberg's procedure were negligible.

Conclusions:

  • The permutation step-down (PSD) procedure is a reliable method for controlling FWR in RM designs with multiple outcomes.
  • The PSD procedure offers a powerful alternative to standard Bonferroni corrections, especially when accounting for variable dependencies.
  • Researchers should consider using the PSD procedure for more accurate and powerful hypothesis testing in RM designs.