Affiliation:
1. Department of Economics & Management, University of Trento, 38100 Trento, Italy
Abstract
The aim of this paper is to consider the indeterminate Stieltjes moment problem together with all its probability density functions that have the positive real or the entire real axis as support. As a consequence of the concavity of the entropy function in both cases, there is one such density that has the largest entropy: we call it fhmax, the largest entropy density. We will prove that the Jaynes maximum entropy density (MaxEnt), constrained by an increasing number of integer moments, converges in entropy to the largest entropy density fhmax. Note that this kind of convergence implies convergence almost everywhere, with remarkable consequences in real applications in terms of the reliability of the results obtained by the MaxEnt approximation of the underlying unknown distribution, both for the determinate and the indeterminate case.
Reference19 articles.
1. Convergence of finite moment approximations in Hamburger and Stieltjes problems;Milev;Stat. Prob. Lett.,2017
2. Entropy-convergence in Stieltjes and Hamburger moment problem;Frontini;Appl. Math. Comput.,1997
3. Information theory and statistical mechanics;Jaynes;Phys. Rev.,1957
4. Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley-Interscience.
5. Novi Inverardi, P.L., and Tagliani, A. (2023). Probability Distributions Approximation via Fractional Moments and Maximum Entropy: Theoretical and Computational Aspects. Axioms, 13.