On stochastic Kaczmarz type methods for solving large scale systems of ill-posed equations

Abstract

Abstract In this article we investigate a family of stochastic gradient type methods for solving systems of linear ill-posed equations. The method under consideration is a stochastic version of the projective Landweber–Kaczmarz method in Leitão and Svaiter (2016 Inverse Problems 32 025004) (see also Leitão and Svaiter (2018 Numer. Funct. Anal. Optim. 39 1153–80)). In the case of exact data, mean square convergence to zero of the iteration error is proven. In the noisy data case, we couple our method with an a priori stopping rule and characterize it as a regularization method for solving systems of linear ill-posed operator equations. Numerical tests are presented for two linear ill-posed problems: (i) a Hilbert matrix type system with over 108 equations; (ii) a big data linear regression problem with real data. The obtained results indicate superior performance of the proposed method when compared with other well-established random iterations. Our preliminary investigation indicates that the proposed iteration is a promising alternative for computing stable approximate solutions of large scale systems of linear ill-posed equations.