Affiliation:
1. School of Electrical and Computer Engineering, Georgia Institute of Technology
2. School of Electrical and Computer Engineering, Georgia Institute of Technology, 777 Atlantic Drive NW, Atlanta, GA 30332-0250, USA
Abstract
Abstract
This paper considers the problem of estimating a low-rank matrix from the observation of all or a subset of its entries in the presence of Poisson noise. When we observe all entries, this is a problem of matrix denoising; when we observe only a subset of the entries, this is a problem of matrix completion. In both cases, we exploit an assumption that the underlying matrix is low-rank. Specifically, we analyse several estimators, including a constrained nuclear-norm minimization program, nuclear-norm regularized least squares and a non-convex constrained low-rank optimization problem. We show that for all three estimators, with high probability, we have an upper error bound (in the Frobenius norm error metric) that depends on the matrix rank, the fraction of the elements observed and the maximal row and column sums of the true matrix. We furthermore show that the above results are minimax optimal (within a universal constant) in classes of matrices with low-rank and bounded row and column sums. We also extend these results to handle the case of matrix multinomial denoising and completion.
Funder
NSF
Alfred P. Sloan Foundation
Publisher
Oxford University Press (OUP)
Subject
Applied Mathematics,Computational Theory and Mathematics,Numerical Analysis,Statistics and Probability,Analysis
Reference49 articles.
1. Tensor Decompositions for Learning Latent Variable Models;Anandkumar;J. Mach. Learn. Res.,2014
2. A practical algorithm for topic modeling with provable guarantees;Arora,2013
3. Sharp nonasymptotic bounds on the norm of random matrices with independent entries;Bandeira;Ann. Probab.,2016
4. A provable SVD-based algorithm for learning topics in dominant admixture corpus;Bansal,2014
5. A fast algorithm with minimax optimal guarantees for topic models with an unknown number of topics;Bing,2018
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献