Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Maximizing the Directional Derivative

Maximizing the Directional Derivative

The directional derivative is a central concept in multivariable calculus that describes how a function changes at a given point when moving in a specified direction. This direction is represented by a unit vector, ensuring that only the orientation influences the rate of change. By varying the direction, different rates of change can be observed, demonstrating that the directional derivative depends strongly on the chosen direction.The directional derivative is computed using the gradient...

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...

Modeling with Differential Equations

Modeling with Differential Equations

Population dynamics can be described mathematically by considering the population size P(t) as a function of time. The rate of change of the population is then represented by the derivative of P(t). A simple assumption is that the rate of growth is proportional to the size of the population itself. This leads to an exponential growth model, where the population increases rapidly without bound. While this is a useful first approximation, it does not reflect realistic long-term...

Neural Regulation

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

Differential Equations: Problem Solving

Differential Equations: Problem Solving

When analyzing the motion of falling objects, it is essential to consider not only the force of gravity but also the opposing force of air resistance. A practical example involves releasing a heavy test weight during a safety check on a ship. As the weight falls from rest, gravity accelerates it downward while air resistance exerts an upward force that increases with velocity. This dynamic interplay of forces is well described by differential equations, which provide a mathematical framework...

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Gold catalyzed double condensation reaction: Synthesis, antimicrobial and cytotoxicity of spirooxindole derivatives.

Bioorganic & medicinal chemistry letters·2016

Same author

Role of supportive maintenance therapy on implant survival: a university-based 17 years retrospective analysis.

International journal of dental hygiene·2015

Same author

A flavonoid isolated from Streptomyces sp. (ERINLG-4) induces apoptosis in human lung cancer A549 cells through p53 and cytochrome c release caspase dependant pathway.

Chemico-biological interactions·2014

Same author

Cu(OTf)2 catalyzed three component reaction: efficient synthesis of spiro[indoline-3,4'-pyrano[3,2-b]pyran derivatives and their anticancer potency towards A549 human lung cancer cell lines.

Bioorganic & medicinal chemistry letters·2013

Same author

Odor representations in the mammalian olfactory bulb.

Wiley interdisciplinary reviews. Systems biology and medicine·2010

Same author

Hopfield model associative memory with nonzero-diagonal terms in memory matrix.

Applied optics·2010

Search research articles

Related Experiment Videos

Gradient methods for the optimization of dynamical systems containing neural networks.

K S Narendra¹, K Parthasarathy

¹Dept. of Electr. Eng., Yale Univ., New Haven, CT.

IEEE Transactions on Neural Networks

|January 1, 1991

Summary

Dynamic backpropagation optimizes multilayer neural network weights by integrating gradient methods from linear dynamical systems. This approach enhances the performance index calculation for complex, interconnected systems.

Related Experiment Videos

Area of Science:

Artificial Intelligence
Machine Learning
Dynamical Systems Theory

Background:

Backpropagation is a standard algorithm for training artificial neural networks.
Optimizing weights in multilayer neural networks is crucial for their performance.
Existing methods may face challenges with complex, interconnected systems.

Purpose of the Study:

To introduce dynamic backpropagation, an extension of the backpropagation method.
To provide a straightforward approach for optimizing neural network weights.
To enable the gradient calculation for performance indices in nonlinear dynamical systems.

Main Methods:

The study extends the backpropagation algorithm.
It combines gradient methods from linear dynamical systems with neural network backpropagation.
The method is applicable to systems composed of interconnected linear dynamical systems and multilayer neural networks.

Main Results:

Dynamic backpropagation offers a method for optimizing weights in multilayer neural networks.
It facilitates the gradient computation for performance indices in nonlinear dynamical systems.
The approach is suitable for complex, interconnected systems.

Conclusions:

Dynamic backpropagation is a viable extension of the backpropagation method.
The technique simplifies the optimization of neural network parameters.
Diagrammatic representations are emphasized for practical implementation.