通过数据驱动的细分来增加回归
Shayan Alahyari1, Shiva Mehdipour Ghobadlou2, Mike Domaratzki1
1Department of Computer Science, Western University, London, Ontario, Canada.
概括
本研究引入了一种使用生成对抗网络 (GAN) 和Mahalanobis-Gaussian混合模型 (GMM) 的新型数据驱动框架,通过识别和增加少数样本来有效解决不平衡回归挑战.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 失衡回归发生在目标分布偏斜时,阻碍了代表性不足的样本上的模型性能.
- 当前的方法经常使用任意的值,无法捕捉罕见数据的复杂特征-目标关系.
- 这种限制影响了各种应用程序,这些应用程序需要准确预测不常见事件.
研究的目的:
- 为不平衡回归开发一个完全数据驱动的框架,自动识别和丰富少数样本.
- 克服现有数据增强技术中固定值的局限性.
- 提高机器学习模型在偏斜数据集上的性能.
主要方法:
- 提出了一个基于生成对抗网络 (GAN) 的增强框架.
- 马哈拉诺比斯-高斯混合模型 (GMM) 用于少数样本的自动识别.
- 确定性近邻匹配用于丰富稀疏的数据区域.
主要成果:
- 提出的方法成功地识别了真正罕见的观测,而不依赖预设的值.
- 在32个基准不平衡回归数据集上进行评估,该框架表现出卓越的性能.
- 在不平衡回归任务中超越现有的最先进的数据增强技术.
结论:
- 与Mahalanobis-GMM一起提出的基于GAN的框架为不平衡回归提供了一个强大的,数据驱动的解决方案.
- 这种方法有效地解决了代表性不足的样本的挑战,通过准确地识别和增强样本.
- 该方法显示了在现实世界偏斜数据场景中改善机器学习模型性能的巨大潜力.
相关概念视频
01:52Regression Toward the Mean
6.9K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.9K
01:25Multiple Regression
3.8K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.8K
00:53Correlation and Regression
3.2K
In statistics, correlation describes the degree of association between two variables. In the subfield of linear regression, correlation is mathematically expressed by the correlation coefficient, which describes the strength and direction of the relationship between two variables. The coefficient is symbolically represented by 'r' and ranges from -1 to +1. A positive value indicates a positive correlation where the two variables move in the same direction. A negative value suggests a...
3.2K
01:11Regression Analysis
8.1K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
8.1K
01:18Microsoft Excel: Regression Analysis
1.5K
Regression analysis in Microsoft Excel is a powerful statistical method for examining the relationship between a dependent variable and one or more independent variables. It's used extensively in fields such as economics, biology, and business to predict outcomes, understand relationships, and make data-driven decisions. The most common type is linear regression, which attempts to fit a straight line through the data points to model the relationship between variables.
To perform regression...
To perform regression...
1.5K
01:27ATP Driven Pumps I: An Overview
9.7K
ATP-driven pumps, also known as transport ATPases, are integral membrane proteins. They have binding sites for ATP located on the membrane's cytosolic side and the ion-conducting domain in the transmembrane region. These pumps use the free energy released from ATP hydrolysis to move the solutes across cell membranes against an electrochemical gradient.
There are four main types of ATP-driven pumps - P-type, V-type, F-type, and ABC transporter. All these pumps are of varying complexities and...
There are four main types of ATP-driven pumps - P-type, V-type, F-type, and ABC transporter. All these pumps are of varying complexities and...
9.7K