Related Experiment Video
Updated: Jul 11, 2026
10:26
Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Statistical considerations in identifying mechanisms of change
1Center on Alcoholism, Substance Abuse and Addictions, Department of Psychology, University of New Mexico, Albuquerque, NM 87131, USA. jtonigan@unm.edu
Alcoholism, Clinical and Experimental Research
|October 27, 2007
Summary
This study addresses inflated Type I error rates in mediation analysis, a common issue in statistical research. It proposes using Bonferroni adjustment or a design-based approach to prevent false positives in mediation tests.
Area of Science:
- Statistics
- Psychology
- Behavioral Science
Background:
- Mediation analysis is crucial for understanding mechanisms of change in various scientific fields.
- Common methods like Structural Equation Modeling (SEM) and Multivariate Regression Analysis (MRA) are frequently used.
- The issue of inflated Type I error rates in sequential mediation testing is often overlooked.
Purpose of the Study:
- To highlight the problem of inflated Type I error rates in statistical mediation tests.
- To offer practical solutions for avoiding Type I errors in mediation analysis.
- To provide examples from addiction research to illustrate the proposed methods.
Main Methods:
- Discusses the limitations of current sequential testing approaches in mediation.
- Proposes the use of a Bonferroni adjustment as a straightforward solution.
- Introduces a design-based approach to test rival explanations for observed effects.
Main Results:
- Identifies the significant problem of inflated Type I error rates in standard mediation analysis.
- Demonstrates that existing popular methods (SEM, MRA) do not adequately address this issue.
- Presents two viable strategies to control Type I errors in mediation tests.
Conclusions:
- The current practices in mediation analysis carry a substantial risk of false positives.
- Implementing Bonferroni adjustment or a design-based approach can mitigate Type I errors.
- These methods are essential for ensuring the validity of findings in mediation research, particularly in fields like addiction studies.
Related Concept Videos
01:37Statistical Significance
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
01:52Regression Toward the Mean
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
01:23Mechanistic Models: Compartment Models in Individual and Population Analysis
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least squares (OLS)...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:25Statistical Methods for Analyzing Epidemiological Data
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
01:25Strategies for Assessing and Addressing Confounding
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...