多重统计测试的危险:对错误阳性进行控制
David Sidebotham1, Xiaoyu Chen2
1Cardiothoracic and Vascular Intensive Care Unit, Auckland City Hospital, Auckland, New Zealand; Department of Anaesthesiology, Faculty of Health Science, University of Auckland, Auckland, New Zealand.
British journal of anaesthesia
|January 26, 2026
概括
统计测试有错误,就像假阳性一样. 控制多次测试至关重要,因为假阳性风险随着更多的测试显著增加,影响研究可靠性.
科学领域:
- 统计 统计 统计 统计
- 生物统计学 生物统计学
- 研究方法研究方法研究方法学
背景情况:
- 统计测试本质上会产生错误,包括假阳性 (I型错误) 和假阴性 (II型错误).
- 错误的阳性通常是使用家庭错误率 (FWER) 或错误发现率 (FDR) 控制来管理的.
- 0.05的显著性值意味着每次测试的错误阳性率为5%,但这种风险在多次测试中大幅增加.
研究的目的:
- 讨论陈和德克斯特关于控制错误阳性结果的模拟研究的发现.
- 检查各种多重测试校正方法的优缺点.
主要方法:
- 审查和讨论最近的模拟研究,比较假阳性对照方法.
- 分析不同的统计方法来管理多重比较.
主要成果:
- 至少有一个假阳性 (FWER) 的概率随着独立测试的数量而大大增加.
- 例如,在20次测试中,FWER在0.05显著程度时超过60%.
- 该研究强调了在没有适当的纠正的情况下执行众多统计测试所带来的重大风险.
结论:
- 多重统计测试需要仔细考虑错误率,以保持结果的完整性.
- 控制错误阳性结果的不同方法有不同的优缺点,研究人员必须权衡.
- 了解和应用适当的多重测试策略对于可靠的科学结论至关重要.
相关概念视频
Statistical Hypothesis Testing
6.9K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
6.9K
Introduction to Statistical Process Control
638
Statistical Process Control (SPC) is a method used to monitor and control quality within processes, particularly in manufacturing and service delivery, by employing statistical methods. SPC aims to distinguish between natural (common cause) variation and variation due to specific changes or events (special cause), allowing for timely improvements and sustained quality. The control chart, a pivotal tool in SPC, visually displays data over time alongside a central line of upper and lower control...
638
Multiple Comparison Tests
4.5K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.5K
Statistical Significance
21.3K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
21.3K
False Memories
457
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
457
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
482
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
482


