Waiting times for patterns in a sequence of multistate trials

Abstract

Let Xn, n ≥ 1 be a sequence of trials taking values in a given set A, let ∊ be a pattern (simple or compound), and let Xr,∊ be a random variable denoting the waiting time for the rth occurrence of ∊. In the present article a finite Markov chain imbedding method is developed for the study of Xr,∊ in the case of the non-overlapping and overlapping way of counting runs and patterns. Several extensions and generalizations are also discussed.