Abstract
AbstractThe exploration versus exploitation dilemma is a critical issue in human information acquisition and sequential belief formation, and the multi-armed bandit problem has been widely used to address it. Because of its high descriptive accuracy, the SGU model, which combines SoftMax type probabilistic selection, Gaussian process regression type belief updating, and upper confidence interval type evaluation, has attracted much attention. However, this model assumes that the analyst has access to the returns from people’s choices, but in many realistic tasks, this assumption cannot be made because only choices are observable. Moreover, many of the returns are subjective. The authors introduce a new model-fitting method that overcomes this barrier and evaluates its performance using data sets derived from agent-based simulations and real consumer data. This approach has the potential to significantly broaden the range of issues to which the SGU model can be applied.
Funder
Japan Society for the Promotion of Science
Tokyo University of Science
Publisher
Springer Science and Business Media LLC
Subject
Computer Science Applications,Economics, Econometrics and Finance (miscellaneous)
Reference39 articles.
1. Anandkumar, A., Michael, N., Tang, A. K., et al. (2011). Distributed algorithms for learning and cognitive medium access with logarithmic regret. IEEE Journal on Selected Areas in Communications, 29(4), 731–745.
2. Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002). Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2), 235–256.
3. Averbeck, B. B. (2015). Theory of choice in bandit, information sampling and foraging tasks. PLoS Computational Biology, 11(3), e1004164.
4. Bishop, C. M., & Nasrabadi, N. M. (2006). Pattern recognition and machine learning (Vol. 4). Springer.
5. Bubeck, S., Stoltz, G., & Szepesvári, C., et al. (2008). Online optimization in x-armed bandits. Advances in Neural Information Processing Systems, pp. 21.