Abstract
AbstractThe classical Method of Successive Approximations (MSA) is an iterative method for solving stochastic control problems and is derived from Pontryagin’s optimality principle. It is known that the MSA may fail to converge. Using careful estimates for the backward stochastic differential equation (BSDE) this paper suggests a modification to the MSA algorithm. This modified MSA is shown to converge for general stochastic control problems with control in both the drift and diffusion coefficients. Under some additional assumptions the rate of convergence is shown. The results are valid without restrictions on the time horizon of the control problem, in contrast to iterative methods based on the theory of forward-backward stochastic differential equations.
Funder
Alan Turing Institute
Engineering and Physical Sciences Research Council
Publisher
Springer Science and Business Media LLC
Subject
Applied Mathematics,Control and Optimization
Reference37 articles.
1. Antonelli, F.: Backward-forward stochastic differential equations. Ann. Appl. Probab. 3, 777–793 (1993)
2. Bellman, R.: Functional equations in the theory of dynamic programming. V. Positivity and quasi-linearity. Proc. Natl Acad. Sci. U.S.A. 41(10), 743–746 (1955)
3. Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
4. Boltyanskii, V.G., Gamkrelidze, R.V., Pontryagin, L.S.: Theory of optimal processes. I. The maximum principle. Izv. Akad. Nauk SSSR Ser. Mat. 24(1), 3–42 (1960)
5. Carmona, R.: Lectures on BSDEs, Stochastic Control, and Stochastic Differential Games with Financial Applications. SIAM, Philadelphia (2016)
Cited by
7 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献