An optimal control problem without control costs
Related Experiment Video
Updated: Aug 7, 2025

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control
Published on: August 15, 2020
1Department of Mathematics and Industrial Engineering, Polytechnique Montréal, C.P. 6079, Succursale Centre-ville, Montréal, H3C 3A7, Canada.
Abstract:
A two-dimensional diffusion process is controlled until it enters a given subset of $ \mathbb{R}^2 $. The aim is to find the control that minimizes the expected value of a cost function in which there are no control costs. The optimal control can be expressed in terms of the value function, which gives the smallest value that the expected cost can take. To obtain the value function, one can make use of dynamic programming to find the differential equation it satisfies. This differential equation is a non-linear second-order partial differential equation. We find explicit solutions to this non-linear equation, subject to the appropriate boundary conditions, in important particular cases. The method of similarity solutions is used.
More Related Videos
06:45Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
Published on: October 28, 2022
11:53Spatial Multiobjective Optimization of Agricultural Conservation Practices using a SWAT Model and an Evolutionary Algorithm
Published on: December 9, 2012
Related Concept Videos
Control Systems
At the heart...
Time-Domain Interpretation of PD Control
Consider the example of control of motor torque. Initially, a positive...
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
Control System Problem
When forming a closed-loop system, issues can arise if the poles cross into the unstable region, leading to potential...
Controller Configurations
Control-system compensation involves various configurations, most commonly series or cascade compensation, in which the controller...
Conservation of Energy in Control Volume
For steady flow systems, the time derivative of the stored energy becomes zero since there is no energy accumulation within the control volume. This simplifies the energy equation to: