Related Experiment Video
Updated: May 17, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Bias and precision of some classical ANOVA effect sizes when assumptions are violated
Susan Troncoso Skidmore1, Bruce Thompson
1Sam Houston State University, Huntsville, TX, USA.
Abstract:
Previous simulation research has focused on evaluating the impact of analytic assumption violations on statistics related to the F test and associated p CALCULATED values. The present article evaluated the bias of classical estimates of practical significance (i.e., effect size sample estimators [Formula: see text], [Formula: see text], and [Formula: see text]) in a one-way between-subjects univariate ANOVA when assumptions are violated. The simulation conditions modeled were selected on the basis of prior empirical research. Estimated (1) sampling error bias and (2) precision computed for each of the three effect size estimates for the 5,000 samples drawn for each of the 270 (5 parameter Cohen's d values × 3 group size ratios × 3 population distribution shapes × 3 variance ratios × 2 total ns) conditions were modeled for each of the k = 2, 3, and 4 group analyses. Our results corroborate the limited previous related research and suggest that [Formula: see text] should not be used as an ANOVA effect size estimator, even though [Formula: see text] is the only available choice in the menus in most commonly available software.
Related Concept Videos
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
One-Way ANOVA: Unequal Sample Sizes
One-Way ANOVA
What is an ANOVA?
Before performing ANOVA, one must ensure that the samples used for this analysis have three crucial characteristics or statistical assumptions. The first assumption states that the samples should be drawn from normally distributed samples, while the second requires that all the drawn samples should be randomly and...
Two-Way ANOVA
The two-way ANOVA analysis initially begins by stating the null hypothesis that there is an interaction effect between the two factors of a dataset. This effect can be visualized using line segments formed by joining the means for...
Statistical Methods to Analyze Parametric Data: ANOVA
One-way ANOVA is applied when a single independent variable or factor is scrutinized. It compares the...

