一种新的零碎线性方法,用于检测变量之间的关联.
1School of Computer Science and Technology, Xidian University, Xi'an, Shaanxi, China.
PloS one
|August 24, 2023
概括
我们引入了一个新的最大关联系数 (MAC) 来检测变量之间的线性和非线性关系. MAC比MIC等现有方法更高效,更准确,在大数据分析中非常有用.
科学领域:
- 统计 统计 统计 统计
- 数据科学数据科学数据科学
- 机器学习 机器学习
背景情况:
- 在大数据分析中,准确检测变量关联是至关重要的.
- 像皮尔森相关 (线性) 和最大信息系数 (MIC) (非线性) 这样的现有方法在范围,计算成本或精度方面都有局限性.
- 需要一种多功能且高效的方法来捕获线性和非线性关联.
研究的目的:
- 提出一种新的最大关联系数 (MAC),用于检测变量之间的线性和非线性关联.
- 用模拟数据评估MAC在通用性和公平性方面的表现.
- 为了证明MAC在现实世界数据集上的实际适用性.
主要方法:
- 开发了一种新的最大关联系数 (MAC) 算法.
- 马克基于这样一个原则:非线性关联可以被分解成零碎的线性组件.
- 该方法使用皮尔森相关系数来检测这些关联.
主要成果:
- 对模拟数据的实验表明,MAC既具有普遍性,也具有公平性.
- 应用到现实世界数据集 (棒球大联盟,信用卡违约) 证实了MAC检测变量关联的能力.
- 证明MAC在计算上是廉价的,并且比最大信息系数 (MIC) 更精确.
结论:
- 最大关联系数 (MAC) 为检测大数据中的线性和非线性关联提供了一个强大而有效的工具.
- 马克的计算效率和精度使其成为MIC等现有方法的有价值替代品.
- 这种方法对未来在各种科学领域的数据分析和解释有潜在的影响.
相关概念视频
Correlation and Regression
1.3K
In statistics, correlation describes the degree of association between two variables. In the subfield of linear regression, correlation is mathematically expressed by the correlation coefficient, which describes the strength and direction of the relationship between two variables. The coefficient is symbolically represented by 'r' and ranges from -1 to +1. A positive value indicates a positive correlation where the two variables move in the same direction. A negative value suggests a...
1.3K
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
Calculating and Interpreting the Linear Correlation Coefficient
6.0K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
6.0K
Multiple Regression
3.0K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.0K
Survival Tree
109
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
109
Scatter Plot
7.0K
The most common and easiest way to display the relationship between two variables, x and y, is a scatter plot. A scatter plot shows the direction of a relationship between the variables. A clear direction happens when there is either:
7.0K


