1. Bather, J. Optimal stationary policies for denumerable Markov chains in continuous time. Adv, Appl. Prob., 8 (1976), 144–158.
2. Bertsekas, D. P. Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall, Englewood Cliffs, NJ, 1987.
3. Doshi, B. T. Continuous time control of Markov processes on an arbitrary state space: average return criterion. Stochastic Processes and their Applications, 4 (1976), 55–77
4. Howard, R. A. Dynamic Programming and Markov Processes. Wiley, New York, 1960.
5. Kakumanu, P. Nondiscounted continuous time Markov decision processes with countable state space. SIAM J. Control, 10 (1972), 210–220.