Bonferroni's method, not Tukey's, should be used to control the total number of false positives when making multiple pairwise comparisons in experiments with few replicates
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
View abstract on PubMed
Summary
This summary is machine-generated.Tukey's method for multiple comparisons in experiments often allows too many false positives, especially with small sample sizes. Bonferroni correction offers better control of errors without sacrificing much statistical power.
Area Of Science
- Statistics
- Experimental Design
- Biostatistics
Background
- Statistical tests, particularly ANOVA, are crucial for determining experimental effects.
- When comparing multiple groups, controlling Type 1 errors (false positives) is essential to avoid incorrect conclusions.
- Tukey's method is commonly used for pairwise comparisons but may be unreliable with small sample sizes.
Purpose Of The Study
- To evaluate the effectiveness of ANOVA followed by various post-hoc tests in controlling false positives.
- To assess the impact of small sample sizes (2-6 replicates) and multiple experimental groups (3-6) on error rates.
- To identify reliable statistical methods for post-hoc analysis in typical laboratory settings.
Main Methods
- Monte Carlo simulations were employed to model experimental scenarios.
- The performance of ANOVA with Tukey's method and 11 other post-hoc tests was simulated.
- Control of Type 1 error rates was assessed under varying group numbers and sample sizes.
Main Results
- Tukey's method demonstrated inadequate control of false positives under the simulated conditions.
- Most tested post-hoc methods offered minimal improvement over Tukey's method in error control.
- The Bonferroni correction proved effective in controlling false positives, even with limited statistical power.
Conclusions
- Researchers should avoid using Tukey's method for all pairwise comparisons with ANOVA when sample sizes are small.
- The Bonferroni correction is recommended for controlling false positives in pre-selected comparisons.
- Careful selection of post-hoc tests is critical for maintaining statistical rigor in experimental research.
These videos have been matched automatically. Contact us if they are not relevant.
These videos have been matched automatically. Contact us if they are not relevant.
Related Concept Videos
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...