1. E. Altman, “Constrained Markov decision processes with total cost criteria: occupation measures and primal LP,” Math. Methods Oper. Res.
43 pp. 45–72, 1996.
2. E. Altman, Constrained Markov Decision Processes, Chapman & Hall/CRC, Boca Raton, 1999.
3. E.J. Balder, “On compactness of the space of policies in stochastic dynamic programming,” Stoch. Proc. Appl.
32 pp. 141–151, 1989.
4. D.P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, Englewood Cliffs, NJ, 1978
5. D.P. Bertsekas and S. Shreve, Stochastic Optimal Control: the Discrete Time Case, Academic Press, New York, 1978 (reprinted by Athena Scientific, Belmont, 1996).