Abstract
Consider a stochastic process X(t) (t ≧ 0) taking values in a countable state space, say, {1, 2,3, …}. To be picturesque we think of X(t) as the state which a particle is in at epoch t. Suppose the particle moves from state to state in such a way that the successive states visited form a Markov chain, and that the particle stays in a given state a random amount of time depending on the state it is in as well as on the state to be visited next. Below is a possible realization of such a process.
Publisher
Cambridge University Press (CUP)
Subject
Applied Mathematics,Statistics and Probability
Reference51 articles.
1. Some investigations concerning recurrent stochastic processes of a certain type;Takács;Magyar Tud. Akad. Mat. Kutatô Int. Közl.,1954
2. On the limiting distributions in Markov renewal processes with finitely many states
3. Regenerative stochastic processes
4. Some peculiar semi-Markov processes. Proc;Smith;Fifth Berkeley Symp. Math. Statist. Prob.,1965
5. A Convexity Property in the Theory of Random Variables Defined on a Finite Markov Chain
Cited by
333 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献