Some exact results for dams with Markovian inputs

Abstract

In the theory of dams with Markovian inputs explicit results are not usually obtained, as the theory depends very heavily on the largest eigenvalue of the matrix (pijzj) where pij are the transition probabilities of the input process. In this paper we show that explicit results can be obtained if one considers an input process of a special form. The probability distribution of the time to first emptiness is obtained for both the finite and the infinite dam, as well as the stationary distribution of the dam content for the finite dam. Explicit results are given for the case where the stationary distribution of the input process has a geometric distribution.