The Dynamics of Cumulative Step Size Adaptation on the Ellipsoid Model
Hans-Georg Beyer1, Michael Hellwig2
1Department of Computer Science, Research Center Process and Product Engineering, Vorarlberg University of Applied Sciences, Dornbirn, 6850, Austria hans-georg.beyer@fhv.at.
Abstract:
The behavior of the [Formula: see text]-Evolution Strategy (ES) with cumulative step size adaptation (CSA) on the ellipsoid model is investigated using dynamic systems analysis. At first a nonlinear system of difference equations is derived that describes the mean value evolution of the ES. This system is successively simplified to finally allow for deriving closed-form solutions of the steady state behavior in the asymptotic limit case of large search space dimensions. It is shown that the system exhibits linear convergence order. The steady state mutation strength is calculated, and it is shown that compared to standard settings in [Formula: see text] self-adaptive ESs, the CSA control rule allows for an approximately [Formula: see text]-fold larger mutation strength. This explains the superior performance of the CSA in non-noisy environments. The results are used to derive a formula for the expected running time. Conclusions regarding the choice of the cumulation parameter c and the damping constant D are drawn.
Related Concept Videos
Second Order systems II
Linear Approximation in Time Domain
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
Design Example: Creating a Hydraulic Model of a Dam Spillway
Dynamics Of Circular Motion: Applications
Dynamics of Circular Motion
Any acceleration must be produced by some force. Therefore, any force or combination of forces can cause centripetal acceleration. A few examples include the tension in the rope on a...
Modeling with Differential Equations


