CG Versus MINRES: An Empirical Comparison

Abstract

For iterative solution of symmetric systems  the conjugate gradient method (CG) is commonly used when A is positive definite, while the minimum residual method (MINRES) is typically reserved for indefinite systems. We investigate the sequence of approximate solutions  generated by each method and suggest that even if A is positive definite, MINRES may be preferable to CG if iterations are to be terminated early. In particular, we show for MINRES that the solution norms  are monotonically increasing when A is positive definite (as was already known for CG), and the solution errors  are monotonically decreasing. We also show that the backward errors for the MINRES iterates  are monotonically decreasing.