Spiking Adaptive Dynamic Programming Based on Poisson Process for Discrete-Time Nonlinear Systems
Related Experiment Video
Updated: Nov 1, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
Published on: March 25, 2014
Abstract:
In this article, a new iterative spiking adaptive dynamic programming (SADP) method based on the Poisson process is developed to solve optimal impulsive control problems. For a fixed time interval, combining the Poisson process and the maximum likelihood estimation (MLE), the three-tuple of state, spiking interval, and probability of Poisson distribution can be computed, and then, the iterative value functions and iterative control laws can be obtained. A property analysis method is developed to show that the value functions converge to optimal performance index function as the iterative index increases from zero to infinity. Finally, two simulation examples are given to verify the effectiveness of the developed algorithm.
Related Concept Videos
Poisson's And Laplace's Equation
Poisson Probability Distribution
The...
BIBO stability of continuous and discrete -time systems
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
Nonlinear Pharmacokinetics: Causes of Nonlinearity
Nonlinear drug absorption can occur when the process is rate-limited by solubility, carrier-mediated transport systems, or saturation of the presystemic gut wall or hepatic metabolism. For instance, high doses of riboflavin...
Linear time-invariant Systems
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...

