1. D. Aldous, J. Fill, Reversible Markov chains and random walks on graphs, 1999, in preparation. Available at: http://www.stat.berkeley.edu/users/aldous/RWG/book.html
2. Singular perturbations of Markov chains and decision processes;Avrachenkov,2001
3. The fundamental matrix of singularly perturbed Markov chains;Avrachenkov;Adv. in Appl. Probab.,1999
4. Directed graphs, Hamiltonicity and doubly stochastic matrices;Borkar;Random Structures Algorithms,2004
5. Discrete dynamic programming;Blackwell;Ann. of Math. Statist.,1962