1. On the iterative method of dynamic programming on a finite space discrete time Markov process;Brown;Ann. Math. Statist.,1965
2. Stochastic Processes;Doob,1953
3. Weak ergodicity in nonhomogeneous Markov-chains;Hajnal,1958
4. Ergodic theorems for sequences of infinite stochastic matrices;Paz,1967
5. Introduction to Probabilistic Automata;Paz,1971