Related Experiment Video
Updated: Sep 30, 2026

Experimental Investigation of Secondary Flow Structures Downstream of a Model Type IV Stent Failure in a 180° Curved Artery Test Section
Published on: July 19, 2016
Fast curvature matrix-vector products for second-order gradient descent
1IDSIA, Galleria 2, 6928 Manno, Switzerland. nic@inf.ethz.ch
Abstract:
We propose a generic method for iteratively approximating various second-order gradient steps - Newton, Gauss-Newton, Levenberg-Marquardt, and natural gradient - in linear time per iteration, using special curvature matrix-vector products that can be computed in O(n). Two recent acceleration techniques for on-line learning, matrix momentum and stochastic meta-descent (SMD), implement this approach. Since both were originally derived by very different routes, this offers fresh insight into their operation, resulting in further improvements to SMD.
Related Concept Videos
Second Derivatives and Laplace Operator
Consider a scalar function. The curl of its...
Gradient Fields
Gradient Vectors and Their Applications
Vector Transformation in Rotating Coordinate Systems
Gradient and Del Operator
Derivatives of Vector Functions
