Strong Optimality of Bold Play for Discounted Dubins-Savage Gambling Problems with Time-Dependent Parameters

Abstract

In the classic Dubins-Savage subfair primitive casino gambling problem, the gambler can stake any amount in his possession, winning (1 − r)/r times the stake with probability w and losing the stake with probability 1 − w, 0 ≤ w ≤ r ≤ 1. The gambler seeks to maximize the probability of reaching a fixed fortune (the goal) by gambling repeatedly with suitably chosen stakes. This problem has recently been extended in a unifying framework to account for limited playing time as well as future discounting, under which bold play is known to be optimal provided that w ≤ ½ ≤ r. This paper is concerned with a further extension of the Dubins-Savage gambling problem involving time-dependent parameters, and shows that bold play not only maximizes the probability of reaching the goal, but also stochastically minimizes the number of plays needed to reach the goal. As a result, bold play also maximizes the expected utility, where the utility at the goal is only required to be monotone decreasing with respect to the number of plays needed to reach the goal. It is further noted that bold play remains optimal even when the time-dependent parameters are random.