1. R. A. Howard. Dynamic Programming and Markov Processes. Massachusetts: MIT Press, 1960.
2. I. Karatzas, W. D. Sudderth. Two characterizations of optimality in dynamic programming. Applied Mathematics and Optimization, 2010, 61(3):421–434.
3. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. In Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics. New York: John Wiley & Sons, 1994.
4. N. L. Stokey, R. E. Lucas. Recursive Methods in Economic Dynamics. Cambridge: Harvard University Press, 1989.
5. D. Blackwell. Positive dynamic programming. Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability — Volume 1: Statistics. Berkeley: University of California Press, 1967:415–418.