1. Watkins CJ, Dayan P (1992) Q-learning. Mach Learn 8(3–4):279–292
2. Szepesvári C et al. (1998) The asymptotic convergence-rate of q-learning. In: Advances in neural information processing systems, 1064–1070
3. Ghavamzadeh M, Kappen H, Azar M, Munos R (2011) Speedy q-learning. In: Advances in neural information processing systems, vol. 24
4. Bhatnagar D et al. (2021) Finite horizon q-learning: stability, convergence and simulations. arXiv preprint arXiv:2110.15093
5. Majeed SJ, Hutter M (2018) On q-learning convergence for non-markov decision processes. In: IJCAI vol. 18, 2546–2552