Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

What is an Electrochemical Gradient?

What is an Electrochemical Gradient?

Adenosine triphosphate, or ATP, is considered the primary energy source in cells. However, energy can also be stored in the electrochemical gradient of an ion across the plasma membrane, which is determined by two factors: its chemical and electrical gradients.The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an ion’s...

Gradient and Del Operator

Gradient and Del Operator

In mathematics and physics, the gradient and del operator are fundamental concepts used to describe the behavior of functions and fields in space. The gradient is a mathematical operator that gives both the magnitude and direction of the maximum spatial rate of change. Consider a person standing on a mountain. The slope of the mountain at any given point is not defined unless it is quantified in a particular direction. For this reason, a "directional derivative" is defined, which is a vector...

Gradient Vectors and Their Applications

Gradient Vectors and Their Applications

Every point on a topographical map corresponds to a particular elevation, so the landscape can be modeled as a surface whose height depends on horizontal position. From any given location, a hiker may face infinitely many directions, but only one direction produces the fastest possible increase in elevation. This unique route is called the direction of steepest ascent, and in multivariable calculus, it is represented by the gradient vector of the elevation function.The gradient vector points...

Maximizing the Directional Derivative

Maximizing the Directional Derivative

The directional derivative is a central concept in multivariable calculus that describes how a function changes at a given point when moving in a specified direction. This direction is represented by a unit vector, ensuring that only the orientation influences the rate of change. By varying the direction, different rates of change can be observed, demonstrating that the directional derivative depends strongly on the chosen direction.The directional derivative is computed using the gradient...

Significance of the Gradient Vector

Significance of the Gradient Vector

A surface defined by a function of two variables can be understood by examining how it changes along specific directions. When one variable is held constant, the surface reduces to a curve that reflects variation in the other variable. For example, fixing one variable and moving parallel to a coordinate axis produces a cross-sectional curve. The slope of this curve at a given point represents how the function changes in that particular direction, providing a measure of local steepness.By...

Gradient Fields

Gradient Fields

A gradient field is a vector field derived from a scalar field. A scalar field assigns a single numerical value to every point in space, such as temperature, pressure, or electric potential. The gradient field describes how that value changes from point to point. It gives both the direction of the fastest increase and the rate of change in that direction.For a scalar field f(x, y), the gradient is written as\begin{equation*}\nabla f=\left\langle \jfrac{\partial f}{\partial x},\jfrac{\partial...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A feasibility study on active sound reduction across an acoustic plenum window by cancelling source clusters on internal periphery of the window cavity.

The Journal of the Acoustical Society of America·2024

Same author

A BERT Framework to Sentiment Analysis of Tweets.

Sensors (Basel, Switzerland)·2023

Same author

EEG-based emotion recognition using hybrid CNN and LSTM classification.

Frontiers in computational neuroscience·2022

Same author

I-Vector-Based Patient Adaptation of Deep Neural Networks for Automatic Heartbeat Classification.

IEEE journal of biomedical and health informatics·2019

Same author

Towards End-to-End ECG Classification With Raw Signal Extraction and Deep Neural Networks.

IEEE journal of biomedical and health informatics·2018

Same author

Filtering electrocardiographic signals using an unbiased and normalized adaptive noise reduction system.

Medical engineering & physics·2008

Search research articles

Related Experiment Videos

Magnified gradient function with deterministic weight modification in adaptive learning.

Sin-Chun Ng¹, Chi-Chung Cheung, Shu-Hung Leung

¹School of Science and Technology, The Open University of Hong Kong, Hong Kong, China. scng@ouhk.edu.hk

IEEE Transactions on Neural Networks

|November 30, 2004

Summary

This study introduces two novel neural network algorithms, magnified gradient function backpropagation (MGFPROP) and deterministic weight modification (DWM), to enhance learning speed and global convergence. The combined MDPROP algorithm demonstrates superior performance over standard backpropagation for various learning tasks.

Related Experiment Videos

Area of Science:

Artificial Intelligence
Machine Learning
Neural Networks

Background:

Standard backpropagation (BP) algorithms face limitations in convergence rate and global convergence capability.
Improving the efficiency of neural network training is crucial for complex learning problems.

Purpose of the Study:

To introduce and evaluate two novel approaches, MGFPROP and DWM, for accelerating BP convergence and enhancing global convergence.
To investigate the performance of an integrated algorithm, MDPROP, combining MGFPROP and DWM.

Main Methods:

Magnified Gradient Function Backpropagation (MGFPROP): Magnifies the gradient function of the activation function to increase convergence rate.
Deterministic Weight Modification (DWM): Deterministically modifies network weights to reduce system error in multilayered feedforward neural networks.
MDPROP: Integrates MGFPROP and DWM to leverage the benefits of both approaches.

Main Results:

Both MGFPROP and DWM individually show improved performance compared to standard BP and other modified BP algorithms.
The integrated MDPROP algorithm consistently outperforms MGFPROP, DWM, and standard BP in terms of convergence rate and global convergence capability.
Simulation results validate the effectiveness of the proposed algorithms across multiple learning problems.

Conclusions:

MGFPROP and DWM offer significant improvements over standard backpropagation for neural network training.
The MDPROP algorithm represents a substantial advancement, providing enhanced convergence rate and global convergence capability.
The proposed methods are effective for a range of learning problems, offering a more efficient alternative to existing BP algorithms.