Abstract
Various authors have derived the necessary and sufficient conditions for optimality in semi-Markov decision processes in which the state remains constant between jumps. In this paper similar results are presented for a generalized semi-Markov decision process in which the state varies between jumps according to a Markov process with continuous sample paths. These results are specialized to a general storage model and an application to the service rate control in a GI/G/1 queue is indicated.
Publisher
Cambridge University Press (CUP)
Subject
Statistics, Probability and Uncertainty,General Mathematics,Statistics and Probability
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
1. The Virtues of Hesitation: Optimal Timing in a Non-Stationary World;American Economic Review;2015-03-01
2. Semi‐Markov Processes ‐ Basic;Wiley StatsRef: Statistics Reference Online;2014-09-29
3. The Stochastic Quality Calculus;Lecture Notes in Computer Science;2014
4. Semi-Markov Processes;Encyclopedia of Statistical Sciences;2006-08-15
5. A Second bibliography on semi-Markov processes;Semi-Markov Models;1986