Abstract
AbstractWe review sublinear modeling in probabilistic graphical models by statistical mechanical informatics and statistical machine learning theory. Our statistical mechanical informatics schemes are based on advanced mean-field methods including loopy belief propagations. This chapter explores how phase transitions appear in loopy belief propagations for prior probabilistic graphical models. The frameworks are mainly explained for loopy belief propagations in the Ising model which is one of the elementary versions of probabilistic graphical models. We also expand the schemes to quantum statistical machine learning theory. Our framework can provide us with sublinear modeling based on the momentum space renormalization group methods.
Reference116 articles.
1. J.C.D. MacKay, Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)
2. D. Koller, N. Friedman, Probabilistic Graphical Models: Principles and Techniques (MIT Press, 2009)
3. P.K. Murphy, Machine Learning: A Probabilistic Perspective (MIT Press, 2012)
4. I. Rish, G.Y. Grabarnik, Sparse Modelling: Theory, Algorithms, and Applications (Chapman & Hall/CRC, 2015)
5. T. Hastie, R. Tibshirani, M.J. Wainwright, Statistical Learning with Sparsity: The Lasso and Generalizations (Chapman & Hall/CRC, 2015)