1. Federgruen, A., andSchweitzer, P. J.,Nonstationary Markov Decision Problems with Converging Parameters, Journal of Optimization Theory and Applications, Vol. 34, pp. 207–241, 1981.
2. Bertsekas, D. P.,Dynamic Programming and Stochastic Control, Academic Press, New York, New York, 1976.
3. Ross, S. M.,Applied Probability Models with Optimization Applications, Holden-Day, San Francisco, California, 1970.
4. Schäl, M.,Estimation and Control in Discounted Stochastic Dynamic Programming, University of Bonn, Institute of Applied Mathematics, Preprint No. 428, 1981.
5. Kolonko, M.,The Average-Optimal Adaptive Control of a Markov Renewal Model in Presence of an Unknown Parameter, Mathematische Operationsforschung und Statistik, Serie Optimization, Vol. 13, pp. 567–591, 1982.