Laws of Large Numbers for Non-Homogeneous Markov Systems

Abstract

AbstractIn the present we establish Laws of Large Numbers for Non-Homogeneous Markov Systems and Cyclic Non-homogeneous Markov systems. We start with a theorem, where we establish, that for a NHMS under certain conditions, the fraction of time that a membership is in a certain state, asymptotically converges in mean square to the limit of the relative population structure of memberships in that state. We continue by proving a theorem which provides the conditions under which the mode of covergence is almost surely. We continue by proving under which conditions a Cyclic NHMS is Cesaro strongly ergodic. We then proceed to prove, that for a Cyclic NHMS under certain conditions the fraction of time that a membership is in a certain state, asymptotically converges in mean square to the limit of the relative population structure in the strongly Cesaro sense of memberships in that state. We then proceed to establish a founding Theorem, which provides the conditions under which, the relative population structure asymptotically converges in the strongly Cesaro sense with geometrical rate. This theorem is the basic instrument missing to prove, under what conditions the Law of Large Numbers for a Cycl-NHMS is with almost surely mode of convergence. Finally, we present two applications firstly for geriatric and stroke patients in a hospital and secondly for the population of students in a University system.