学习了低级别的表示及其理论收分析.
Weilin Shen1, Junmin Liu1, Xiangyu Chang2
1School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, People's Republic of China; SGIT AI Lab, State Grid Corporation of China, Xi'an, Shaanxi, 710054, People's Republic of China.
概括
本研究引入了新的深度学习模型,即学习低级别表示 (LLRR) 和具有部分权重合 (LLRR-PWC) 的LLRR,用于分析高维数据. 这些模型表明,在低级别的代表任务中,趋同和实际表现得到了改善.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 高维数据分析依赖于稀疏表示和低级近似.
- 算法展开到深度神经网络中,已经推进了稀疏建模.
- 使用展开网络的低级别代表性的理论框架尚不发达.
研究的目的:
- 为低级别的代表提出新的深层网络.
- 引入一个带有部分重量合 (LLRR-PWC) 的增强型变种.
- 为拟议的模型提供理论趋同分析.
主要方法:
- 学习低级别代表 (LLRR) 网络的发展.
- 引入具有部分重量合 (LLRR-PWC) 的LLRR.
- 使用设计的网络参数空间对收属性的理论分析.
主要成果:
- 为LLRR-PWC展开的网络架构提供严格的融合保证.
- 在收率方面取得了显著的理论和实证改进.
- 理论主张和实际优势的实验验证.
结论:
- LLRR-PWC提供了一种理论上合理且经验上有效的低级别代表性的方法.
- 这项研究解决了在低等级展开网络中缺乏理论理解的问题.
- 在数据分析中,LLRR-PWC展示了实际价值和适用性.
相关概念视频
Region of Convergence of Laplace Tarnsform
720
The Region of Convergence (ROC) is a fundamental concept in signal processing and system analysis, particularly associated with the Laplace transform. The ROC represents an area in the complex plane where the Laplace transform of a given signal converges, determining the transform's applicability and utility.
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
720
Residuals and Least-Squares Property
7.9K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.9K
Routh-Hurwitz Criterion II
418
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
418
Routh-Hurwitz Criterion I
336
Consider an electrical power grid, where stability is essential to prevent blackouts. The Routh-Hurwitz criterion is a valuable tool for assessing system stability under varying load conditions or faults. By analyzing the closed-loop transfer function, the Routh-Hurwitz criterion helps determine whether the system remains stable.
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
336
Linear Approximation in Frequency Domain
136
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
136
Region of Convergence
562
The z-transform is a powerful mathematical tool used in the analysis of discrete-time signals and systems. It is a crucial tool in the analysis of discrete-time systems, but its convergence is limited to specific values of the complex variable z. This range of values, known as the Region of Convergence (ROC), is fundamental in determining the behavior and stability of a system or signal. The ROC defines the region in the complex plane where the z-transform converges, which can take various...
562


