LIT-LVM:使用隐性变量模型的线性预测器中相互作用术语的结构化规范化
Mohammadreza Nemati1, Zhipeng Huang2, Kevin S Xu1
1Department of Computer and Data Sciences, Case Western Reserve University.
概括
本研究介绍了LIT-LVM,这是一种用于准确估计线性模型中的相互作用项系数的新方法. LIT-LVM利用低维结构来提高预测准确性,特别是在高维数据集中.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 线性预测器是统计学和机器学习的基础.
- 建模非线性关系往往需要交互条款,这可能导致高维的挑战.
- 现有的调节器,如拉索和弹性网,有助于减轻过,但可能无法完全捕捉复杂的相互作用结构.
研究的目的:
- 开发一种方法来准确估计线性预测器中相互作用项的系数.
- 引入基于假设的相互作用系数低维结构的结构正规化方法.
- 提供可解释的低维特征的潜伏表示.
主要方法:
- 提出了一种新的方法,LIT-LVM (隐性交互术语 - 隐性矢量模型),它假定交互系数具有近似的低维结构.
- 用一个低维空间中的潜向量来表示每个特征.
- 评估了LIT-LVM与弹性网,层次拉索和因子化机器等既定方法相比.
主要成果:
- 在各种模拟和现实数据集中,LIT-LVM表现出卓越的预测准确性.
- 该方法在相互作用项数量与样本数量相比较大时表现出特别高的有效性.
- 与弹性网,等级拉索和因子化机器相比,实现了更好的性能.
结论:
- 假设的相互作用系数的低维结构有效地提高了预测准确性.
- 对于高维数据,LIT-LVM提供了一种强大的结构化规范化技术.
- 由LIT-LVM生成的潜在表示有助于特征可视化和关系分析.
相关概念视频
Residuals and Least-Squares Property
9.6K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
9.6K
Multiple Regression
4.1K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
4.1K
Regression Toward the Mean
7.2K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
7.2K
Quadratic Models
259
Quadratic models are mathematical representations used to describe relationships in which the rate of change changes at a constant rate. These models appear in a wide variety of natural and engineered systems, especially those involving motion, forces, and optimization. One common application is analyzing the vertical motion of objects influenced by gravity, such as a ball thrown into the air.In such scenarios, the object's height changes over time in a curved pattern, rising to a maximum point...
259
Linearization and Approximation
85
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
85
Truncation in Survival Analysis
652
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
652


