Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Application of Linearization and Approximation01:29

Application of Linearization and Approximation

129
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
129
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

380
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
380
Linearization and Approximation01:26

Linearization and Approximation

128
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
128
Acceleration Vectors01:30

Acceleration Vectors

23.7K
In everyday conversation, accelerating means speeding up. Acceleration is a vector in the same direction as the change in velocity, Δv, therefore the greater the acceleration, the greater the change in velocity over a given time. Since velocity is a vector, it can change in magnitude, direction, or both. Thus acceleration is a change in speed or direction, or both. For example, if a runner traveling at 10 km/h due east slows to a stop, reverses direction, and continues their run at 10 km/h...
23.7K
Application of Nonlinear Inequalities01:29

Application of Nonlinear Inequalities

286
A nonlinear inequality describes a comparison involving an expression that curves or behaves more complexly than a straight line. These inequalities often appear in forms that include squares, products, or variables in the denominator.To solve such an inequality, one starts by rewriting it so that zero appears on one side. For example, the inequality:  can be factored as: This form makes it easier to identify the values that cause the expression to equal zero. In this case, the...
286
Application of Antiderivatives: Linear Motion01:26

Application of Antiderivatives: Linear Motion

85
A derivative describes how one quantity changes with respect to another, such as how velocity changes over time. The reverse process, which recovers a quantity from its rate of change, is known as integration. In physics, integration is fundamental because it links related physical quantities, allowing acceleration, velocity, and displacement to be understood as connected aspects of motion.Consider a car traveling at a steady speed of 20 meters per second when an obstacle appears 800 meters...
85

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Accelerated first-order optimization under nonlinear constraints.

Mathematical programming·2026
Same author

Safety versus performance: How multi-objective learning reduces barriers to market entry.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Deep generative modeling of sample-level heterogeneity in single-cell genomics.

Nature methods·2025
Same author

Functional protein mining with conformal guarantees.

Nature communications·2025
Same author

VI-VS: calibrated identification of feature dependencies in single-cell multiomics.

Genome biology·2024
Same author

Prediction-powered inference.

Science (New York, N.Y.)·2023
Same journal

Chemotactic self-organization captures the dynamics of mammalian hair follicle patterning.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Tomographic imaging of superconducting order using particle-hole interference.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Inhibitory potential of autologous neutralizing antibodies sets quantitative limits on the rebound-competent HIV-1 reservoir.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Inferring epidemiological parameters under an infectious phylogeography model with visitor dynamics.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Analytical modeling for suction cup designs for skin-interfaced wearable devices.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same journal

Improving cell-free metabolism through direct integration of artificial respiratory chains.

Proceedings of the National Academy of Sciences of the United States of America·2026
See all related articles

Related Experiment Video

Updated: Mar 12, 2026

A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
13:54

A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM

Published on: August 18, 2023

6.2K

A variational perspective on accelerated methods in optimization.

Andre Wibisono1, Ashia C Wilson2, Michael I Jordan3,2

  • 1Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720.

Proceedings of the National Academy of Sciences of the United States of America
|November 12, 2016
PubMed
Summary
This summary is machine-generated.

This study reveals a unified continuous-time framework for accelerated optimization methods. A Bregman Lagrangian unifies various accelerated algorithms, showing they traverse the same spacetime curve at different speeds.

Keywords:
Bregman divergenceLagrangian frameworkaccelerated methodsconvex optimizationmirror descent

More Related Videos

Spatial Multiobjective Optimization of Agricultural Conservation Practices using a SWAT Model and an Evolutionary Algorithm
11:53

Spatial Multiobjective Optimization of Agricultural Conservation Practices using a SWAT Model and an Evolutionary Algorithm

Published on: December 9, 2012

13.6K

Related Experiment Videos

Last Updated: Mar 12, 2026

A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
13:54

A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM

Published on: August 18, 2023

6.2K
Spatial Multiobjective Optimization of Agricultural Conservation Practices using a SWAT Model and an Evolutionary Algorithm
11:53

Spatial Multiobjective Optimization of Agricultural Conservation Practices using a SWAT Model and an Evolutionary Algorithm

Published on: December 9, 2012

13.6K

Area of Science:

  • Optimization Theory
  • Continuous-Time Systems
  • Numerical Analysis

Background:

  • Accelerated gradient methods are crucial for efficient optimization, with Nesterov's method being a key development.
  • The precise scope and unifying principles behind various acceleration techniques remain an active research area.

Purpose of the Study:

  • To investigate accelerated methods from a continuous-time perspective.
  • To identify a unifying framework that encompasses diverse accelerated optimization algorithms.
  • To clarify the relationship between continuous-time dynamics and discrete-time accelerated methods.

Main Methods:

  • Formulation of a Bregman Lagrangian functional.
  • Analysis of continuous-time limits for various accelerated methods.
  • Comparison of trajectories in spacetime for different algorithms.

Main Results:

  • The Bregman Lagrangian generates a broad class of continuous-time accelerated methods.
  • Continuous-time limits of these methods correspond to identical spacetime curves traveled at varying speeds.
  • Nesterov's acceleration and its extensions are interpreted as discretizations of these continuous-time curves.

Conclusions:

  • A continuous-time perspective provides a natural framework for understanding and unifying accelerated optimization methods.
  • The Bregman Lagrangian offers a principled way to derive and analyze accelerated algorithms.
  • This work clarifies the fundamental nature of acceleration in optimization.