Affiliation:
1. Faculty of Engineering, University of Deusto, 48007 Bilbao, Spain
Abstract
This manuscript provides a comprehensive exploration of Probabilistic latent semantic analysis (PLSA), highlighting its strengths, drawbacks, and challenges. The PLSA, originally a tool for information retrieval, provides a probabilistic sense for a table of co-occurrences as a mixture of multinomial distributions spanned over a latent class variable and adjusted with the expectation–maximization algorithm. The distributional assumptions and the iterative nature lead to a rigid model, dividing enthusiasts and detractors. Those drawbacks have led to several reformulations: the extension of the method to normal data distributions and a non-parametric formulation obtained with the help of Non-negative matrix factorization (NMF) techniques. Furthermore, the combination of theoretical studies and programming techniques alleviates the computational problem, thus making the potential of the method explicit: its relation with the Singular value decomposition (SVD), which means that PLSA can be used to satisfactorily support other techniques, such as the construction of Fisher kernels, the probabilistic interpretation of Principal component analysis (PCA), Transfer learning (TL), and the training of neural networks, among others. We also present open questions as a practical and theoretical research window.
Subject
Computer Science (miscellaneous)
Reference208 articles.
1. Hofmann, T. (1999, January 15–19). Probabilistic latent semantic indexing. Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, USA.
2. Hofmann, T. (1999, January 1–5). Probabilistic latent semantic analysis. Proceedings of the Uncertainty in Artificial Intelligence, Eindhoven, The Netherlands.
3. Hofmann, T. (2001). Machine Learning, Springer.
4. Indexing by latent semantic analysis;Deerwester;J. Am. Soc. Inf. Sci.,1990
5. Saul, L., and Pereira, F. (1997). Aggregate and mixed-order Markov models for statistical language processing. arXiv.