Affiliation:
1. Department of Computer Science, Norwegian University of Science and Technology, Norway
2. Center for Applied Autonomous Sensor Systems, Örebro University, Sweden
Abstract
In traditional decision-theoretic planning, information gathering is a means to a goal. The agent receives information about its environment (state or observation) and uses it as a way to optimize a state-based reward function. Recent works, however, have focused on application domains in which information gathering is not only the mean but the goal itself. The agent must optimize its knowledge of the environment. However, traditional Markov-based decision-theoretic models cannot account for rewarding the agent based on its knowledge, which leads to the development of many approaches to overcome this limitation. We survey recent approaches for using decision-theoretic models in information-gathering scenarios, highlighting common practices and existing generic models, and show that existing methods can be categorized into three classes:
reactive sensing
,
single-agent active sensing
, and
multi-agent active sensing
. Finally, we highlight potential research gaps and suggest directions for future research.
Publisher
Association for Computing Machinery (ACM)
Subject
General Computer Science,Theoretical Computer Science
Reference80 articles.
1. A Research Agenda for Hybrid Intelligence: Augmenting Human Intellect With Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence
2. Game-Theoretic Goal Recognition Models with Applications to Security Domains
3. Mauricio Araya-López, Olivier Buffet, Vincent Thomas, and François Charpillet. 2010. A POMDP extension with belief-dependent rewards. In Proceedings of the 24th Annual Conference on Neural Information Processing Systems (NeurIPS’10), John D. Lafferty, Christopher K. I. Williams, John Shawe-Taylor, Richard S. Zemel, and Aron Culotta (Eds.). Curran Associates, Inc., 64–72.
4. Oracular Partially Observable Markov Decision Processes: A Very Special Case
5. An approach to autonomous science by modeling geological knowledge in a Bayesian framework