The policy which maximises long-term survival of an animal faced with the risks of starvation and predation

Abstract

This paper presents a simple model of the decision problems which face many animals in the wild. Animals have an upper limit to the amount of energy reserves which can be stored as body fat. They constantly use energy and find food as a stochastic process. Death occurs if energy reserves fall to zero or if the animal is taken by a predator. Typically animals have a range of behavioural options which differ in the distribution of food gained and in the associated predation risk. There is often a trade-off between starvation and predation in that animals have to expose themselves to higher predation risks in order to gain more food. The above situation is modelled as a finite-state, finite-time-horizon Markov decision problem. The policy which maximises long-term survival probability is characterised. As special cases two trade-offs are analysed. It is shown that an animal should take fewer risks in terms of predation as its reserves increase, and that an animal should reduce the variability of its food supply at the expense of its mean gain as its reserves increase.