1. Finite state and action MDPs;Kallenberg,2002
2. M.L. Littman, T.L. Dean, L.P. Kaelbling, On the complexity of solving Markov decision problems, in: Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, 1995, pp. 394–402.
3. Markov Decision Processes: Discrete Stochastic Dynamic Programming;Puterman,1994
4. Solving h-horizon, stationary Markov Decision Problems in time proportional to log(h);Tseng;Oper. Res. Lett.,1990
5. The simplex and policy-iteration methods are strongly polynomial for the Markov Decision Problem with a fixed discount rate;Ye;Math. Oper. Res.,2011