应该使用Bonferroni的方法,而不是Tukey的方法来控制假阳性总数,当在实验中进行多次对对比时,实验中只有少数复制品
1The Department of Molecular and Cell Biology, University of Connecticut at Storrs, 91N. Eagleville Rd., Storrs, CT 06269-3125, USA.
SLAS discovery : advancing life sciences R & D
|July 23, 2025
概括
图基在实验中进行多重比较的方法经常允许太多的假阳性结果,特别是在小样本大小的情况下. 邦费罗尼校正可以更好地控制错误,而不会牺牲太多的统计能力.
科学领域:
- 统计 统计 统计 统计
- 实验设计 实验设计
- 生物统计学 生物统计学
背景情况:
- 统计测试,特别是ANOVA,对于确定实验效应至关重要.
- 在比较多组时,控制1型错误 (假阳性) 是必要的,以避免错误的结论.
- 图基的方法通常用于对对比,但在小样本大小的情况下可能不可靠.
研究的目的:
- 评估ANOVA的有效性,然后进行各种后期测试,以控制错误阳性.
- 评估小样本大小 (2-6个复制品) 和多个实验组 (3-6个) 对错误率的影响.
- 在典型的实验室环境中确定可靠的后期分析的统计方法.
主要方法:
- 蒙特卡洛模拟被用来模拟实验场景.
- 模拟了ANOVA与Tukey的方法以及其他11个后期测试的性能.
- 对1型错误率的控制在不同的组数和样本大小下进行了评估.
主要成果:
- 在模拟条件下,Tukey的方法证明了对假阳性的控制不足.
- 大多数经过测试的特设后方法在错误控制方面对Tukey的方法提供了最小的改进.
- 邦费罗尼校正证明有效地控制了假阳性,即使具有有限的统计能力.
结论:
- 当样本大小小时,研究人员应避免使用Tukey的方法与ANOVA进行所有对对比.
- 建议使用邦费罗尼校正来控制预先选择的比较中的假阳性.
- 仔细选择后期测试对于保持实验研究中的统计学严谨性至关重要.
相关概念视频
Bonferroni Test
2.8K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.8K
Multiple Comparison Tests
4.0K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.0K
Friedman Two-way Analysis of Variance by Ranks
299
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
299
Identifying Statistically Significant Differences: The F-Test
2.1K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
2.1K
Testing a Claim about Population Proportion
3.4K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.4K
One-Way ANOVA: Equal Sample Sizes
3.5K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.5K


