饮食:条件独立性测试与剩余信息边际依赖度的剩余信息测试
Mukund Sudarshan1, Aahlad Puli1, Wesley Tansey2
1Computer Science, New York University.
概括
我们介绍了脱独立性测试 (DIET),这是条件随机化测试 (CRT) 的计算效率高的方法. 饮食增强了统计能力,避免了现有的CRT方法的常见局限性.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
- 因果推理因果推理
背景情况:
- 条件随机化测试 (CRT) 对于评估变量之间的预测关系,同时考虑共变量至关重要.
- 传统的CRT是计算密集型的,因为需要适应多种预测模型,这限制了它们的实际应用.
- 减少CRT计算成本的现有方法通常通过使用数据分割或交互启发学来损害统计能力.
研究的目的:
- 为条件随机化测试开发一个计算可处理和统计强大的算法.
- 解决现有的CRT方法的局限性,特别是计算难以处理和功耗损失.
- 引入一种新的方法,即脱独立测试 (DIET),用于测试条件独立关系.
主要方法:
- 拟议的脱独立测试 (DIET) 利用边际独立统计数据来测试条件独立.
- DIET涉及测试两个导出的随机变量的边际独立性,称为"信息残留".
- 该方法使用这些信息残留之间的相互信息作为增强功率的测试统计数据.
主要成果:
- DIET确保了有限样本类型-1 错误控制,并实现了超过类型-1 错误率的功率.
- 饮食中的相互信息统计提供了最强大的条件有效测试.
- 经验评估表明,DIET在合成和现实世界的数据集上比其他可处理的CRT更强大.
结论:
- 解独立性测试 (DIET) 为条件随机化测试提供了一个计算效率高,统计能力强大的替代方案.
- 饮食克服了与现有的计算可处理的CRT方法相关的功率损失问题.
- 这种新的方法推进了因果推理和预测建模领域,通过使条件独立性评估更强大.
更多相关视频
09:23Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans
Published on: August 16, 2017
8.1K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
802
相关概念视频
Introduction to Test of Independence
2.3K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.3K
Hypothesis Test for Test of Independence
3.6K
The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test is used to examine the independence of the variables. One can construct two qualitative survey questions or experiments based on the variables in a contingency table. The goal is to see if the two variables are unrelated (independent) or related (dependent). The null and alternative hypotheses for this test are:
H0: The two variables (factors)...
H0: The two variables (factors)...
3.6K
Determination of Expected Frequency
2.2K
Suppose one wants to test independence between the two variables of a contingency table. The values in the table constitute the observed frequencies of the dataset. But how does one determine the expected frequency of the dataset? One of the important assumptions is that the two variables are independent, which means the variables do not influence each other. For independent variables, the statistical probability of any event involving both variables is calculated by multiplying the individual...
2.2K
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Goodness-of-Fit Test
3.4K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.4K
Test for Homogeneity
2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
