概括
显著性测试通常无法控制真实实验中的真假阳性率 (FPR). 缩小参数估计被提议作为一个更可靠的替代 p 值调整的可靠的科学结论.
科学领域:
- 科学研究中的统计数据.
- 实验设计和分析.
背景情况:
- 显著性测试在科学学科中广泛用于数据分析.
- 它旨在控制假阳性,为假设测试提供理论保证.
- 然而,真正的假阳性率 (FPR) 往往远高于理论上保证的.
研究的目的:
- 调查为什么虚假阳性率 (FPR) 在实践中很少得到有效控制.
- 为更可靠地控制统计错误提出替代方法.
- 倡导缩小参数估计,而不是传统的p值调整.
主要方法:
- 该研究对经典意义测试框架进行了批判性分析.
- 它考察了科学家在错误率控制方面的实际限制和自由.
- 它讨论了后期假设生成和反复数据分析对FPR的影响.
主要成果:
- 显著性测试的理论保证在现实世界的实验环境中往往没有得到满足.
- 在选择错误率,测试和纠正方面的灵活性使强大的错误控制复杂化.
- 重复的分析和数据积累导致PFR膨胀和不可靠的结果.
结论:
- 经典显著性测试经常无法有效控制错误阳性率 (FPR).
- 调整后的p值可能误导性地小,导致错误的结论和可重现性问题.
- 缩小参数估计是作为p值调整的首选替代方案,以获得可靠的科学推断.
相关概念视频
Accuracy and Errors in Hypothesis Testing
176
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
176
Errors In Hypothesis Tests
4.2K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
4.2K
Hypothesis: Accept or Fail to Reject?
27.6K
The outcome of any hypothesis testing leads to rejecting or not rejecting the null hypothesis. This decision is taken based on the analysis of the data, an appropriate test statistic, an appropriate confidence level, the critical values, and P-values. However, when the evidence suggests that the null hypothesis cannot be rejected, is it right to say, 'Accept' the null hypothesis?
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null...
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null...
27.6K
Types of Hypothesis Testing
26.2K
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
26.2K
Statistical Hypothesis Testing
1.9K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
1.9K
Bonferroni Test
2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K


