Abstract
Humans choose actions based on both habit and planning. Habitual control is computationally frugal but adapts slowly to novel circumstances, whereas planning is computationally expensive but can adapt swiftly. Current research emphasizes the competition between habits and plans for behavioral control, yet many complex tasks instead favor their integration. We consider a hierarchical architecture that exploits the computational efficiency of habitual control to select goals while preserving the flexibility of planning to achieve those goals. We formalize this mechanism in a reinforcement learning setting, illustrate its costs and benefits, and experimentally demonstrate its spontaneous application in a sequential decision-making task.
Funder
DOD | Office of Naval Research
Publisher
Proceedings of the National Academy of Sciences
Reference59 articles.
1. Goals and Habits in the Brain
2. Animal intelligence: An experimental study of the associative processes in animals;Thorndike;Psychol Monogr,1898
3. Norman DA Shallice T (1986) Attention to action: Willed and automatic control of behavior. Consciousness and Self-Regulation, Advances in Research and Theory, eds Davidson RJ, Schwartz GE, Shapiro D (Springer, New York), Vol 4, pp 1–18
4. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
5. The Curse of Planning
Cited by
123 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献