Author:
Kastius Alexander,Schlosser Rainer
Abstract
AbstractDynamic pricing is considered a possibility to gain an advantage over competitors in modern online markets. The past advancements in Reinforcement Learning (RL) provided more capable algorithms that can be used to solve pricing problems. In this paper, we study the performance of Deep Q-Networks (DQN) and Soft Actor Critic (SAC) in different market models. We consider tractable duopoly settings, where optimal solutions derived by dynamic programming techniques can be used for verification, as well as oligopoly settings, which are usually intractable due to the curse of dimensionality. We find that both algorithms provide reasonable results, while SAC performs better than DQN. Moreover, we show that under certain conditions, RL algorithms can be forced into collusion by their competitors without direct communication.
Publisher
Springer Science and Business Media LLC
Subject
Strategy and Management,Economics and Econometrics,Finance,Business and International Management
Reference30 articles.
1. Bondoux, N., A.Q. Nguyen, T. Fiig, and R. Acuna-Agost. 2020. Reinforcement learning applied to airline revenue management. Journal of Revenue and Pricing Management 19: 332–348.
2. Calvano, E., G. Calzolari, V. Denicolò, and S. Pastorello. 2019. Artificial intelligence, algorithmic pricing and collusion. American Economic Review 110: 3267–3297.
3. den Boer, A.V. 2015. Dynamic pricing and learning: Historical origins, current research, and new directions. Surveys in Operations Research and Management Science 20: 1–18.
4. Espeholt, L., H. Soyer, R. Munos, K. Simonyan, V. Mnih, T. Ward, Y. Doron, V. Firoiu, T. Harley, I. Dunning, S. Legg, and K. Kavukcuoglu. 2018. IMPALA: Scalable distributed deep-rl with importance weighted actor-learner architectures. Proceedings of the 35th International Conference on Machine Learning, in PMLR 80: 1407–1416.
5. Ghasemkhani, A., and L. Yang. 2018. Reinforcement learning based pricing for demand response. In: 2018 IEEE international conference on communications workshops, ICC workshops 2018-proceedings. 2018 (pp. 1–6). Kansas City, MO, USA: IEEE.
Cited by
20 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献