Related Experiment Video
Updated: Mar 26, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
A Comparison of Methods to Test for Mediation in Multisite Experiments
Abstract:
A Monte Carlo study extended the research of MacKinnon, Lockwood, Hoffman, West, and Sheets (2002) for single-level designs by examining the statistical performance of four methods to test for mediation in a multilevel experimental design. The design studied was a two-group experiment that was replicated across several sites, included a single intervening variable and outcome, and assumed that the effects of the treatment and mediator were constant across sites. The findings provide new evidence of the benefits of and further support for using the asymmetric confidence limits approach to test for mediation. In addition, the authors provide further support for using confidence intervals to assess if treatment effects are completely mediated, as using traditional hypothesis testing may lead to erroneous conclusions.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Methods of Medium Optimization
Friedman Two-way Analysis of Variance by Ranks
One-Way ANOVA: Unequal Sample Sizes
Identifying Statistically Significant Differences: The F-Test
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

