Abstract
AbstractIn this paper, we study a Markov decision process with a non-linear discount function and with a Borel state space. We define a recursive discounted utility, which resembles non-additive utility functions considered in a number of models in economics. Non-additivity here follows from non-linearity of the discount function. Our study is complementary to the work of Jaśkiewicz et al. (Math Oper Res 38:108–121, 2013), where also non-linear discounting is used in the stochastic setting, but the expectation of utilities aggregated on the space of all histories of the process is applied leading to a non-stationary dynamic programming model. Our aim is to prove that in the recursive discounted utility case the Bellman equation has a solution and there exists an optimal stationary policy for the problem in the infinite time horizon. Our approach includes two cases: (a) when the one-stage utility is bounded on both sides by a weight function multiplied by some positive and negative constants, and (b) when the one-stage utility is unbounded from below.
Publisher
Springer Science and Business Media LLC
Subject
Applied Mathematics,Control and Optimization
Reference34 articles.
1. Balbus, Ł.: On recursive utilities with non-affine aggregator and conditional certainty equivalent. Econ. Theory 70, 551–577 (2019)
2. Bäuerle, N., Jaśkiewicz, A.: Stochastic optimal growth model with risk-sensitive preferences. J. Econ. Theory 173, 181–200 (2018)
3. Bäuerle, N., Rieder, U.: Markov Decision Processes with Applications to Finance. Springer, Berlin (2011)
4. Becker, R.A., Boyd III, J.H.: Capital Theory. Equilibrium Analysis and Recursive Utility. Blackwell Publishers, New York (1997)
5. Berge, C.: Topological Spaces. MacMillan, New York (1963)
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献