1. Dynamic Programming and Stochastic Control;Bertsekas,1976
2. Convergence of Probability Measures;Billingsley,1968
3. Controlled Markov chains and stochastic networks;Borkar;SIAM J. Control Optim.,1983
4. Finite State Markovian Decision Processes;Derman,1970