Author:
Marković Dimitrije,Reiter Andrea M. F.,Kiebel Stefan J.
Abstract
Precisely timed behavior and accurate time perception plays a critical role in our everyday lives, as our wellbeing and even survival can depend on well-timed decisions. Although the temporal structure of the world around us is essential for human decision making, we know surprisingly little about how representation of temporal structure of our everyday environment impacts decision making. How does the representation of temporal structure affect our ability to generate well-timed decisions? Here we address this question by using a well-established dynamic probabilistic learning task. Using computational modeling, we found that human subjects' beliefs about temporal structure are reflected in their choices to either exploit their current knowledge or to explore novel options. The model-based analysis illustrates a large within-group and within-subject heterogeneity. To explain these results, we propose a normative model for how temporal structure is used in decision making, based on the semi-Markov formalism in the active inference framework. We discuss potential key applications of the presented approach to the fields of cognitive phenotyping and computational psychiatry.
Funder
Deutsche Forschungsgemeinschaft
Brain and Behavior Research Foundation
Subject
Behavioral Neuroscience,Cognitive Neuroscience,Neuropsychology and Physiological Psychology
Reference71 articles.
1. Planning by probabilistic inference,916
AttiasH.
BishopC. M.
FreyJ. B.
Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics2003
2. Discovering event structure in continuous narrative perception and memory;Baldassano;Neuron,2017
3. Timing in reward and decision processes;Bermudez;Philos. Trans. R. Soc. B Biol. Sci,2014
4. Variational inference: a review for statisticians;Blei;J. Am. Stat. Assoc,2017
5. The discovery of processing stages: analyzing EEG data with hidden semi-Markov models;Borst;NeuroImage,2015