使用深度 ReLU 网络对平滑函数的近似计算

Linhao Song1, Ying Liu2, Jun Fan3

  • 1School of Mathematical Science, Beihang University, Beijing, China; School of Data Science, City University of Hong Kong, Kowloon, Hong Kong.

概括

深度神经网络,特别是功能深度ReLU网络,对非线性连续函数的近似能力有所提高. 这项研究为ReLU网络提供了新的理论分析,为各种功能空间提供了更好的近似率.

相关概念视频

Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
101
Linear Approximation in Frequency Domain01:26

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
110
Accuracy, limits, and approximation01:28

Accuracy, limits, and approximation

Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
476
Comparison between RL and RC circuits01:24

Comparison between RL and RC circuits

An RC circuit consists of resistance and capacitance, while in an RL circuit, capacitance is replaced by an inductor. RL and RC circuits are first-order differential circuits that store energy. An RC circuit stores energy in the electric field, while an RL circuit stores energy in the magnetic field. When connected to a battery, an RC circuit charges the capacitor, causing the current to decrease from maximum to zero upon being fully charged. This increases the voltage across the capacitor from...
4.1K
Second Derivatives and Laplace Operator01:22

Second Derivatives and Laplace Operator

The first order operators using the del operator include the gradient, divergence and curl. Certain combinations of first order operators on a scalar or vector function yield second order expressions. Second-order expressions play a very important role in mathematics and physics. Some second order expressions include the divergence and curl of a gradient function, the divergence and curl of a curl function, and the gradient of a divergence function.
Consider a scalar function. The curl of its...
1.3K
RLC Circuit as a Damped Oscillator01:30

RLC Circuit as a Damped Oscillator

An RLC circuit combines a resistor, inductor, and capacitor, connected in a series or parallel combination.
Consider a series RLC circuit. Here, the presence of resistance in the circuit leads to energy loss due to joule heating in the resistance. Therefore, the total electromagnetic energy in the circuit is no longer constant and decreases with time. Since the magnitude of charge, current, and potential difference continuously decreases, their oscillations are said to be damped. This is...
1.1K