Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...

Sequence Networks of Rotating Machines

Sequence Networks of Rotating Machines

A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...

Maximizing the Directional Derivative

Maximizing the Directional Derivative

The directional derivative is a central concept in multivariable calculus that describes how a function changes at a given point when moving in a specified direction. This direction is represented by a unit vector, ensuring that only the orientation influences the rate of change. By varying the direction, different rates of change can be observed, demonstrating that the directional derivative depends strongly on the chosen direction.The directional derivative is computed using the gradient...

Modeling with Differential Equations

Modeling with Differential Equations

Population dynamics can be described mathematically by considering the population size P(t) as a function of time. The rate of change of the population is then represented by the derivative of P(t). A simple assumption is that the rate of growth is proportional to the size of the population itself. This leads to an exponential growth model, where the population increases rapidly without bound. While this is a useful first approximation, it does not reflect realistic long-term...

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Modelling the interaction of ankle-foot orthosis and foot by finite element methods to design an optimized sole in steppage gait.

Journal of medical engineering & technology·2009

Same author

Modelling of human walking to optimise the function of ankle-foot orthosis in Guillan-Barré patients with drop foot.

Singapore medical journal·2009

Same author

Stability of steepest descent with momentum for quadratic functions.

IEEE transactions on neural networks·2008

Same author

A new fuzzy logic filter for image enhancement.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2008

Same author

Multireference adaptive noise canceling applied to the EEG.

IEEE transactions on bio-medical engineering·1997

Same author

The meaning of incontinence: a qualitative study of non-geriatric urinary incontinence sufferers.

Journal of advanced nursing·1993

Search research articles

Related Experiment Videos

Training feedforward networks with the Marquardt algorithm.

M T Hagan, M B Menhaj

IEEE Transactions on Neural Networks

|January 1, 1994

Summary

This summary is machine-generated.

The Marquardt algorithm enhances neural network training by efficiently optimizing feedforward networks with fewer weights, outperforming other methods.

Related Experiment Videos

Area of Science:

Artificial Intelligence
Machine Learning
Computational Neuroscience

Background:

Feedforward neural networks are widely used for complex computational tasks.
Training neural networks often involves solving nonlinear least squares optimization problems.
Backpropagation is a standard algorithm for training neural networks, but can be slow.

Purpose of the Study:

To integrate the Marquardt algorithm into the backpropagation algorithm for training feedforward neural networks.
To evaluate the efficiency of the Marquardt-enhanced backpropagation algorithm.
To compare its performance against other established training algorithms.

Main Methods:

The Marquardt algorithm, a nonlinear least squares technique, was incorporated into the backpropagation framework.
The combined algorithm was applied to various function approximation problems.
Performance was benchmarked against conjugate gradient and variable learning rate algorithms.

Main Results:

The Marquardt algorithm demonstrated significantly higher efficiency in training feedforward neural networks.
This efficiency advantage was particularly notable in networks with a limited number of weights (up to a few hundred).
Compared to conjugate gradient and variable learning rate methods, Marquardt-based training was substantially faster.

Conclusions:

The Marquardt algorithm offers a more efficient approach for training feedforward neural networks, especially for moderately sized networks.
Integrating Marquardt's method into backpropagation provides a powerful optimization tool for machine learning tasks.
This enhanced training method can accelerate the development and application of neural network models.