1. Altman E (1999) Constrained Markov decision processes. Chapman and Hall, London
2. Ash RB (1972) Real analysis and probability. Academic Press, New York
3. Bertsekas DP, Shreve SE (1978) Stochastic optimal control: the discrete-time case. Academic Press, New York
4. Bertsekas DP (1987) Dynamic programming: deterministic and stochastic models. Prentice-Hall, Englewood Cliffs
5. Borkar VS (1998) A convex analytic approach to Markov decision processes. Probab Theory Relat Fields 78:583–602