Abstract
<abstract><p>A two-dimensional diffusion process is controlled until it enters a given subset of $ \mathbb{R}^2 $. The aim is to find the control that minimizes the expected value of a cost function in which there are no control costs. The optimal control can be expressed in terms of the value function, which gives the smallest value that the expected cost can take. To obtain the value function, one can make use of dynamic programming to find the differential equation it satisfies. This differential equation is a non-linear second-order partial differential equation. We find explicit solutions to this non-linear equation, subject to the appropriate boundary conditions, in important particular cases. The method of similarity solutions is used.</p></abstract>
Publisher
American Institute of Mathematical Sciences (AIMS)
Subject
Applied Mathematics,Computational Mathematics,General Agricultural and Biological Sciences,Modeling and Simulation,General Medicine
Reference16 articles.
1. P. Whittle, Optimization Over Time, Vol. I, Wiley, Chichester, 1982.
2. P. Whittle, Risk-Sensitive Optimal Control, Wiley, Chichester, 1990.
3. M. Kounta, N. J. Dawson, Linear quadratic Gaussian homing for Markov processes with regime switching and applications to controlled population growth/decay, Methodol. Comput. Appl. Probab., 23 (2021), 1155–1172. https://doi.org/10.1007/s11009-020-09800-2
4. C. Makasu, Homing problems with control in the diffusion coefficient, IEEE Trans. Autom. Control, 67 (2022), 3770–3772. https://doi.org/10.1109/TAC.2022.3157077
5. M. Lefebvre, Minimizing or maximizing the first-passage time to a time-dependent boundary, Optimization, 71 (2022), 387–401. https://doi.org/10.1080/02331934.2021.1914039