改进了RKHS随机特征监督学习的分析:超越最小平方
Jiamin Liu1, Lei Wang2, Heng Lian3
1School of Mathematics and Physics, University of Science and Technology, Beijing, China.
概括
这项研究增强了基于内核的监督学习与随机的富里埃特征. 使用较少的特征来实现更快的学习速率,用于一般损失函数,匹配以前仅与最小平方损失见到的最佳速率.
科学领域:
- 机器学习 机器学习
- 统计学学习理论
- 核心方法 核心方法
背景情况:
- 基于内核的方法是强大的监督学习.
- 随机里埃特征提供了计算优势.
- 一般损失函数对理论分析提出了挑战.
研究的目的:
- 分析统计错误界限和对使用随机福里埃特征与一般损失函数的内核方法的概括.
- 为了建立更快的学习速度,比以前更少的特征,而不是最小平方损失.
- 解决关于随机特征效率的开放问题.
主要方法:
- 统计错误极限的理论分析.
- 对基于内核的监督学习的概括性质的研究.
- 使用随机里埃特征进行近似.
主要成果:
- 使用随机里埃特征,为一般的利普希茨损失函数建立了更快的学习速率.
- 实现了可比最小平方损失的最佳率,具有显著更少的特征 (o(n)).
- 在源和容量假设下,推导出一个n-2ξ/(2ξ+γ)的速率.
结论:
- 随机里埃函数可以实现一个更广泛的类损失函数的最佳学习率.
- 需要的功能数量大大减少,提高了效率.
- 这项工作为监督学习中的随机里埃特征提供了理论保证.
相关概念视频
Residuals and Least-Squares Property
7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
Routh-Hurwitz Criterion II
180
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
180
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
381
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
On...
381
Multiple Regression
2.9K
Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
2.9K
Outliers and Influential Points
4.0K
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...
4.0K
Linear Approximation in Frequency Domain
85
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
85


