Related Experiment Video
Updated: Feb 10, 2026

11:44
Real-Time DC-dynamic Biasing Method for Switching Time Improvement in Severely Underdamped Fringing-field Electrostatic MEMS Actuators
Published on: August 15, 2014
10.8K
Suboptimal Scheduling in Switched Systems With Continuous-Time Dynamics: A Least Squares Approach
Summary
This study presents two novel policy iteration algorithms for optimal control of switched systems. These methods, including a single loop policy iteration, reduce computational load for complex control tasks.
Area of Science:
- Control Theory
- Systems Engineering
- Applied Mathematics
Background:
- Optimal control of switched systems is computationally intensive.
- Autonomous subsystems and continuous-time dynamics present unique challenges.
Purpose of the Study:
- To develop approximate solutions for optimal control of switched systems.
- To reduce the computational burden associated with policy iteration algorithms.
Main Methods:
- Formulation of a policy iteration (PI) algorithm using recursive least squares.
- Introduction of a computationally efficient single loop PI algorithm.
- Discussion of online and concurrent training algorithms for implementation.
Main Results:
- The presented algorithms offer approximate solutions for complex control problems.
- The single loop PI algorithm effectively reduces computational complexity.
- Numerical simulations validate the effectiveness of the proposed methods.
Conclusions:
- The developed policy iteration algorithms provide viable approaches for optimal control of switched systems.
- The single loop PI offers a practical alternative for reducing computational demands.
- The findings support the application of these methods in real-world control scenarios.
Related Concept Videos
BIBO stability of continuous and discrete -time systems
946
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
946
Continuous -time Fourier Transform
921
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
921
Basic Continuous Time Signals
718
Basic continuous-time signals include the unit step function, unit impulse function, and unit ramp function, collectively referred to as singularity functions. Singularity functions are characterized by discontinuities or discontinuous derivatives.
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
718
Sampling Continuous Time Signal
764
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
In the...
764
Reinforcement Schedules
522
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
522
Linear time-invariant Systems
939
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
939

