Related Experiment Videos
Adaptive critic designs
1Dept. of Electr. Eng., Texas Tech. Univ., Lubbock, TX.
Abstract:
We discuss a variety of adaptive critic designs (ACDs) for neurocontrol. These are suitable for learning in noisy, nonlinear, and nonstationary environments. They have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Our discussion of these origins leads to an explanation of three design families: heuristic dynamic programming, dual heuristic programming, and globalized dual heuristic programming (GDHP). The main emphasis is on DHP and GDHP as advanced ACDs. We suggest two new modifications of the original GDHP design that are currently the only working implementations of GDHP. They promise to be useful for many engineering applications in the areas of optimization and optimal control. Based on one of these modifications, we present a unified approach to all ACDs. This leads to a generalized training procedure for ACDs.
Related Concept Videos
Natural Selection and Adaptation
Beyond physical adaptations, psychological...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Criticisms of the Evolutionary Perspective
Evolutionary psychology provides one explanation for these findings, suggesting...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller aligns...
Self-Discrepancy Theory
Behavior Modification
A real-world application of operant conditioning principles is applied...