Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix-Reference-Cited by-同舟云学术

Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix

Published:1968-09 Issue:9 Volume:11 Page:619-621
ISSN:0001-0782
Container-title:Communications of the ACM
language:en
Short-container-title:Commun. ACM

Author:

Fox B. L.¹,Landi D. M.¹

Affiliation:

1. The RAND Corp., Santa Monica, CA

Abstract

An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix is presented. Applications in Markov renewal programming and in the construction of variable length codes are reviewed, and an updating procedure for dealing with certain sequences of stochastic matrices is discussed. Computation times are investigated experimentally and compared with those of another recently proposed method.

Publisher

Association for Computing Machinery (ACM)

Subject

General Computer Science

Link

https://dl.acm.org/doi/pdf/10.1145/364063.364082

Reference9 articles.

1. Application de la th~orie des graphes: Matrices de Markov et programmes dynamiques;DE GHELLINCK G;Cahiers Centre d'Etude Rech. Op~rat.,1961

2. Multichain Markov Renewal Programs

Cited by 44 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Discrete Markov Processes and Numerical Algorithms for Markov Chains;International Series in Operations Research & Management Science;2024

2. Bayesian selection probability estimation for probabilistic Boolean networks;Asian Journal of Control;2019-07

3. Spectrum Sharing With Decentralized Occupation Control in Rule Regulated Networks;IEEE Transactions on Cognitive Communications and Networking;2019-06

4. Analysis of Markov Influence Graphs;Operations Research;2019-05

5. The Jump Start Power Method: A New Approach for Computing the Ergodic Projector of a Finite Markov Chain;Journal of Scientific Computing;2018-09-20