Variants of residual smoothing with a small residual gap. (English) Zbl 1420.65026

Summary: Short-recurrence Krylov subspace methods, such as conjugate gradient squared-type methods, often exhibit large oscillations in the residual norms, leading to a large residual gap and a loss of attainable accuracy for the approximate solutions. Residual smoothing is useful for obtaining smooth convergence for the residual norms, but it has been shown that this does not improve the maximum attainable accuracy in most cases. In the present study, we reformulate the smoothing scheme from a novel perspective. The smoothed sequences do not usually affect the primary sequences in conventional smoothing schemes. In contrast, we design a variant of residual smoothing in which the primary and smoothed sequences influence each other. This approach enables us to avoid the propagation of large rounding errors, and results in a smaller residual gap, and thus a higher attainable accuracy. We present a rounding error analysis and numerical experiments to demonstrate the effectiveness of our proposed smoothing scheme.


65F10 Iterative numerical methods for linear systems
Full Text: DOI


[1] Aihara, K., Variants of the groupwise update strategy for short-recurrence Krylov subspace methods, Numer. Algorithms, 75, 397-412, (2017) · Zbl 1368.65046
[2] Chan, TF; Gallopoulos, E.; Simoncini, V.; Szeto, T.; Tong, CH, A quasi-minimal residual variant of the Bi-CGStab algorithm for nonsymmetric systems, SIAM J. Sci. Comput., 15, 338-347, (1994) · Zbl 0803.65038
[3] Davis, TA; Hu, Y., The university of Florida sparse matrix collection, ACM Trans. Math. Softw., 38, 1-25, (2011) · Zbl 1365.65123
[4] Fletcher, R.; Watson, GA (ed.), Conjugate gradient methods for indefinite systems, No. 506, 73-89, (1976), Berlin
[5] Fokkema, DR; Sleijpen, GLG; Vorst, HA, Generalized conjugate gradient squared, J. Comput. Appl. Math., 71, 125-146, (1996) · Zbl 0856.65021
[6] Freund, RW, A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems, SIAM J. Sci. Comput., 14, 470-482, (1993) · Zbl 0781.65022
[7] Freund, RW; Nachtigal, NM, QMR: a quasi minimal residual method for non-Hermitian linear systems, Numer. Math., 60, 315-339, (1991) · Zbl 0754.65034
[8] Greenbaum, A., Estimating the attainable accuracy of recursively computed residual methods, SIAM J. Matrix Anal. Appl., 18, 535-551, (1997) · Zbl 0873.65027
[9] Gutknecht, MH; Rozložník, M., By how much can residual minimization accelerate the convergence of orthogonal residual methods?, Numer. Algorithms, 27, 189-213, (2001) · Zbl 0987.65032
[10] Gutknecht, MH; Rozložník, M., Residual smoothing techniques: Do they improve the limiting accuracy of iterative solvers?, BIT, 41, 86-114, (2001) · Zbl 0984.65026
[11] Paige, CC; Saunders, MA, Solutions of sparse indefinite systems of linear equations, SIAM J. Numer. Anal., 12, 617-629, (1975) · Zbl 0319.65025
[12] Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. SIAM, Philadelphia (2003) · Zbl 1031.65046
[13] Schönauer, W.: Scientific Computing on Vector Computers. Elsevier, Amsterdam (1987)
[14] Sleijpen, GLG; Vorst, HA, Reliable updated residuals in hybrid Bi-CG methods, Computing, 56, 141-163, (1996) · Zbl 0842.65018
[15] Sonneveld, P., CGS, a fast Lanczos-type solver for nonsymmetric linear systems, SIAM J. Sci. Stat. Comput., 10, 36-52, (1989) · Zbl 0666.65029
[16] Eshof, J.; Sleijpen, GLG, Inexact Krylov subspace methods for linear systems, SIAM J. Matrix Anal. Appl., 26, 125-153, (2004) · Zbl 1079.65036
[17] Vorst, HA, Bi-CGSTAB: a fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems, SIAM J. Sci. Stat. Comput., 13, 631-644, (1992) · Zbl 0761.65023
[18] Vorst, HA; Ye, Q., Residual replacement strategies for Krylov subspace iterative methods for the convergence of true residuals, SIAM J. Sci. Comput., 22, 835-852, (2000) · Zbl 0983.65039
[19] Weiss, R.: Parameter-Free Iterative Linear Solvers. Mathematical Research, vol. 97. Akademie Verlag, Berlin (1996) · Zbl 0858.65031
[20] Zhou, L.; Walker, HF, Residual smoothing techniques for iterative methods, SIAM J. Sci. Comput., 15, 297-312, (1994) · Zbl 0802.65041
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.