1. Markov Chains with Stationary Transition Probabilities;Chung,1960
2. A First Course in Stochastic Processes;Karlin,1975
3. Finite Markov Chains;Kemeny,1960
4. Stochastic Processes;Ross,1996
5. S. Ross and E. Pekoz, “A Second Course in Probability,” Probabilitybookstore.com, 2006.