Related Experiment Video
Updated: May 15, 2026

06:15
A Multiple Integrated Social Stress Model for Psychiatric Disorders in Female C57BL/6J Mice
Published on: July 15, 2025
Sample size determinations for Welch's test in one-way heteroscedastic ANOVA.
1Chung Yuan Christian University, Taiwan, Republic of China.
The British Journal of Mathematical and Statistical Psychology
|January 16, 2013
Summary
This study compares methods for calculating sample sizes for Welch's test in one-way ANOVA with unequal variances. Levy's (1978a) approach is more accurate than Luh and Guo's (2011) for sample size determination.
Area of Science:
- Statistics
- Biostatistics
- Experimental Design
Background:
- The conventional F test in one-way ANOVA is sensitive to unequal variances (heteroscedasticity).
- Welch's procedure is a robust alternative for comparing means under variance heterogeneity.
- Accurate sample size calculation is crucial for the practical application of Welch's test.
Purpose of the Study:
- To evaluate the accuracy of two approximate power functions for Welch's test in sample size calculations.
- To identify the most reliable method for determining sample size for one-way ANOVA with heteroscedasticity.
Main Methods:
- Conducted simulation studies to compare the performance of two power functions: Levy (1978a) and Luh and Guo (2011).
- Assessed Type I error control and power performance across diverse model configurations and heteroscedastic structures.
- Developed computer programs to implement the recommended power calculation and sample size determination technique.
Main Results:
- Levy's (1978a) power function demonstrated superior accuracy compared to Luh and Guo's (2011) formula.
- The findings held true across a wide range of model specifications and heteroscedastic conditions.
- Welch's procedure, with Levy's method, offers reliable statistical power for unequal variance ANOVA.
Conclusions:
- Levy's (1978a) method is recommended for accurate sample size determination in one-way ANOVA with unequal variances.
- The provided computer programs facilitate the practical implementation of this accurate sample size calculation technique.
- Enhances the utility of Welch's test for researchers dealing with heteroscedastic data.
Related Concept Videos
One-Way ANOVA: Unequal Sample Sizes
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
One-Way ANOVA: Equal Sample Sizes
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
One-Way ANOVA
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
Test for Homogeneity
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can be stated as...
Kruskal-Wallis Test
The Kruskal-Wallis test, also known as the Kruskal-Wallis H test, serves as a nonparametric alternative to the one-way ANOVA, offering a solution for analyzing the differences across three or more independent groups based on a single, ordinal-dependent variable. This statistical test is particularly valuable in scenarios where the data does not meet the normal distribution assumption required by its parametric counterparts. Kruskal-Wallis test is designed typically to handle ordinal data or...
Wilcoxon Rank-Sum Test
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:

