在高维度中稀有减少的等级休伯回归
Kean Ming Tan1, Qiang Sun2, Daniela Witten3
1Department of Statistics, University of Michigan, Ann Arbor, MI.
Journal of the American Statistical Association
|January 29, 2024
概括
我们介绍了一种新的稀疏降级休伯回归方法,用于用重尾噪声进行高维数据分析. 这种方法提供了改进的统计偏差分析和错误界限,优于现有方法.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 由于噪音和复杂性,高维数据分析带来了挑战.
- 现有的降级回归方法经常忽略重尾噪声特征.
- 强大的统计方法对于对复杂数据集的可靠分析至关重要.
研究的目的:
- 开发一种强大的回归方法,用于带有重尾噪声的高维数据.
- 为拟议方法的估计准确性建立理论保证.
- 分析噪声特性与统计偏差之间的权衡.
主要方法:
- 提出一个稀疏的降低级别的休伯回归.
- 使用一个非凸的优化问题的凸放松.
- 使用乘数算法的块坐标下降和交替方向方法.
主要成果:
- 根据弗罗贝尼乌斯和核规范,建立了非对称估计误差极限.
- 量化了噪音重尾和统计偏差之间的权衡.
- 证明的收率取决于噪声时刻边界,匹配第二时刻边界噪声的亚高斯率.
结论:
- 拟议的稀疏降级休伯回归有效地处理高维数据与重尾噪声.
- 理论分析为在不同噪声条件下方法的性能提供了关键的见解.
- 数字研究和数据应用验证了该方法的实际实用性.
关键词:
凸凸的放松方式Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber Huber一个低级别的低级别.稀缺性 是一种稀缺性.这是一个近似的近似.这是一个损失,损失损失.相关概念视频
Friedman Two-way Analysis of Variance by Ranks
197
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
197
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
Routh-Hurwitz Criterion II
248
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
248
Multiple Regression
3.0K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
3.0K


