准确和超高效的p-价值计算用于更高的批判性测试
Wenjia Wang1, Yusi Fang1, Chung Chang2
1Department of Biostatistics, University of Pittsburgh.
概括
本研究介绍了高批判性 (HC) 方法的高效计算策略,改善了其在数据科学中用于检测弱信号的使用. 新的R包"HCp"能够进行大规模的推断,包括COVID-19爆发检测.
科学领域:
- 数据科学数据科学数据科学
- 统计方法 统计方法
- 计算统计学 计算统计学
背景情况:
- 高批判性 (HC) 方法对于在数据科学中检测罕见和弱信号至关重要.
- 计算挑战阻碍了大量p值或重复测试的HC应用.
- 现有的HC计算方法具有显著的局限性,特别是在严格的显著性水平下.
研究的目的:
- 开发一个准确和高效的计算策略,用于四种更高批评 (HC) 方法的变化.
- 解决现有HC方法中的计算瓶和数值问题.
- 为大规模数据分析中的HC应用提供可扩展的解决方案.
主要方法:
- 提出了一种基于交叉的无偏重量抽样方法 (IS) 用于基准测试.
- 开发了一种修改后的SetTest方法 (MST) 来解决数值问题.
- 引入了一种超快速方法 (UFI),使用预先计算的表格和立方斜线插值.
- 将MST,UFI和现有方法集成到R包"HCp"中.
主要成果:
- 拟议的策略证明了HC计算的高效率和准确性.
- R包"HCp"几乎支持任意数量的p值和小p值.
- 该方法已成功应用于COVID-19监测,用于空间时间爆发的检测.
- 模拟证实了大规模推理策略的可行性.
结论:
- 开发的计算策略显著提高了高等批评方法的适用性.
- "HCp" R包为大规模的统计推理提供了一个强大的工具.
- 这种方法对于现实世界的应用,如疾病监测和疫情检测是有效的.
更多相关视频
13:55Combined Immunofluorescence and DNA FISH on 3D-preserved Interphase Nuclei to Study Changes in 3D Nuclear Organization
Published on: February 3, 2013
18.3K
12:22The Use of Reverse Phase Protein Arrays RPPA to Explore Protein Expression Variation within Individual Renal Cell Cancers
Published on: January 22, 2013
33.6K
相关概念视频
P-value
6.7K
P-value is one of the most crucial concepts in statistics.
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
P-value stands for the probability value. P-value is the probability that, if the null hypothesis is true, the results from another randomly selected sample will be as extreme or more extreme as the results obtained from the given sample.
A large P-value calculated from the data indicates to not reject the null hypothesis. But a higher P-value does not mean that the null hypothesis is true. The smaller the P-value, the more...
6.7K
Decision Making: P-value Method
5.3K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.3K
Bonferroni Test
2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Accuracy and Errors in Hypothesis Testing
183
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
183
Fisher's Exact Test
414
Fisher's exact test is a statistical significance test widely used to analyze 2x2 contingency tables, particularly in situations where sample sizes are small. Unlike the chi-squared test, which approximates P-values and assumes minimum expected frequencies of at least five in each cell, Fisher's exact test calculates the exact probability (P-value) of observing the data or more extreme results under the null hypothesis. This feature makes it especially valuable when the assumptions of...
414
Testing a Claim about Population Proportion
3.3K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.3K
