Related Experiment Video
Updated: Mar 6, 2026

Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
Fractional-order gradient descent learning of BP neural networks with Caputo derivative
Jian Wang1, Yanqing Wen1, Yida Gou1
1College of Science, China University of Petroleum, Qingdao, 266580, China.
Abstract:
Fractional calculus has been found to be a promising area of research for information processing and modeling of some physical systems. In this paper, we propose a fractional gradient descent method for the backpropagation (BP) training of neural networks. In particular, the Caputo derivative is employed to evaluate the fractional-order gradient of the error defined as the traditional quadratic energy function. The monotonicity and weak (strong) convergence of the proposed approach are proved in detail. Two simulations have been implemented to illustrate the performance of presented fractional-order BP algorithm on three small datasets and one large dataset. The numerical simulations effectively verify the theoretical observations of this paper as well.
Related Concept Videos
Second Derivatives and Laplace Operator
Consider a scalar function. The curl of its...
First Derivative Test: Problem Solving
Gradient and Del Operator
Higher Derivatives
Derivatives
Newton’s Method