Fractional-order gradient descent learning of BP neural networks with Caputo derivative

Jian Wang1, Yanqing Wen1, Yida Gou1

  • 1College of Science, China University of Petroleum, Qingdao, 266580, China.

Related Concept Videos

Second Derivatives and Laplace Operator01:22

Second Derivatives and Laplace Operator

The first order operators using the del operator include the gradient, divergence and curl. Certain combinations of first order operators on a scalar or vector function yield second order expressions. Second-order expressions play a very important role in mathematics and physics. Some second order expressions include the divergence and curl of a gradient function, the divergence and curl of a curl function, and the gradient of a divergence function.
Consider a scalar function. The curl of its...
2.7K
First Derivative Test: Problem Solving01:25

First Derivative Test: Problem Solving

Imagine an asset price that crashes to a low point, rebounds sharply as bargain-hunters step in, and then gradually declines. Such behavior can be modeled with a smooth function whose turning points represent locally overvalued and undervalued regions. A convenient example that captures rebound followed by decay is:The high and low points of this curve are identified using the first derivative test, which determines where the function changes from increasing to decreasing or vice versa. To...
107
Gradient and Del Operator01:14

Gradient and Del Operator

In mathematics and physics, the gradient and del operator are fundamental concepts used to describe the behavior of functions and fields in space. The gradient is a mathematical operator that gives both the magnitude and direction of the maximum spatial rate of change. Consider a person standing on a mountain. The slope of the mountain at any given point is not defined unless it is quantified in a particular direction. For this reason, a "directional derivative" is defined, which is a vector...
4.8K
Higher Derivatives01:29

Higher Derivatives

In calculus, higher-order derivatives extend the idea of differentiation beyond the first derivative to capture successive rates of change. These derivatives provide detailed information about the behavior of functions and have important applications in both mathematics and physics. To illustrate these concepts, consider the example function\begin{equation*}f(x) = x^3 - x\end{equation*}which serves as a useful case study for exploring higher derivatives.The first derivative represents the slope...
191
Derivatives01:15

Derivatives

DerivativesThe concept of instantaneous rate of change is fundamental in both mathematics and physics, particularly in describing how a moving object alters its position with respect to time. This rate is captured mathematically through the derivative of a function. The derivative at a point represents the slope of the tangent line to the curve of the function at that point and quantifies how the function’s output changes per infinitesimal change in input.Derivative of the Square Root...
274
Newton’s Method01:30

Newton’s Method

Newton’s Method is a powerful iterative technique for approximating the roots of real-valued, differentiable functions, particularly when analytical solutions are impractical. This approach is widely used in scientific computing, engineering, and finance, where equations may be too complex for traditional algebraic methods to handle. The method relies on an iterative process that refines an initial estimate using the function’s derivative to approach the true solution progressively.
86