A preconditioned iteration method for solving Sylvester equations. (English) Zbl 1251.65044

Summary: A preconditioned gradient-based iterative method is derived by judicious selection of two auxiliary matrices. The strategy is based on the Newton’s iteration method and can be regarded as a generalization of the splitting iterative method for system of linear equations. We analyze the convergence of the method and illustrate that the approach is able to considerably accelerate the convergence of the gradient-based iterative method.


65F08 Preconditioners for iterative methods
15A24 Matrix equations and identities
Full Text: DOI


[1] R. Bhatia and P. Rosenthal, “How and why to solve the operator equation AX-XB=Y,” The Bulletin of the London Mathematical Society, vol. 29, no. 1, pp. 1-21, 1997. · Zbl 0909.47011
[2] B. N. Datta, Numerical Methods for Linear Control Systems, Elsevier Academic Press, 2003.
[3] L. Xie, Y. J. Liu, and H.-Z. Yang, “Gradient based and least squares based iterative algorithms for matrix equations AXB+CXTD=F,” Applied Mathematics and Computation, vol. 217, no. 5, pp. 2191-2199, 2010. · Zbl 1210.65097
[4] L. Xie, J. Ding, and F. Ding, “Gradient based iterative solutions for general linear matrix equations,” Computers & Mathematics with Applications, vol. 58, no. 7, pp. 1441-1448, 2009. · Zbl 1189.65083
[5] J. Ding, Y. J. Liu, and F. Ding, “Iterative solutions to matrix equations of the form AiXBi=Fi,” Computers & Mathematics with Applications, vol. 59, no. 11, pp. 3500-3507, 2010. · Zbl 1197.15009
[6] G. H. Golub, S. Nash, and C. Van Loan, “A Hessenberg-Schur method for the problem AX-XB=C,” IEEE Transactions on Automatic Control, vol. 24, no. 6, pp. 909-913, 1979. · Zbl 0421.65022
[7] R. H. Bartels and G. W. Stewart, “Algorithm 432: solution of the matrix equation AX-XB=C,” Communications of the ACM, vol. 15, pp. 820-826, 1972. · Zbl 1372.65121
[8] D. C. Sorensen and Y. K. Zhou, “Direct methods for matrix Sylvester and Lyapunov equations,” Journal of Applied Mathematics, vol. 2003, no. 6, pp. 277-303, 2003. · Zbl 1028.65039
[9] W. H. Enright, “Improving the efficiency of matrix operations in the numerical solution of stiff ordinary differential equations,” ACM Transactions on Mathematical Software, vol. 4, no. 2, pp. 127-136, 1978. · Zbl 0382.65029
[10] D. Calvetti and L. Reichel, “Application of ADI iterative methods to the restoration of noisy images,” SIAM Journal on Matrix Analysis and Applications, vol. 17, no. 1, pp. 165-186, 1996. · Zbl 0849.65101
[11] D. Y. Hu and L. Reichel, “Krylov-subspace methods for the Sylvester equation,” Linear Algebra and Its Applications, vol. 172, no. 15, pp. 283-313, 1992. · Zbl 0777.65028
[12] P. Kirrinnis, “Fast algorithms for the Sylvester equation AX-XBT=C,” Theoretical Computer Science, vol. 259, no. 1-2, pp. 623-638, 2001. · Zbl 0972.68183
[13] G. Starke and W. Niethammer, “SOR for AX-XB=C,” Linear Algebra and Its Applications, vol. 154/156, pp. 355-375, 1991. · Zbl 0736.65031
[14] Q. Niu, X. Wang, and L.-Z. Lu, “A relaxed gradient based algorithm for solving Sylvester equations,” Asian Journal of Control, vol. 13, no. 3, pp. 461-464, 2011. · Zbl 1242.65081
[15] Z.-Z. Bai, “On Hermitian and Skew-Hermitian splitting iteration methods for continuous Sylvester equations,” Journal of Computational Mathematics, vol. 29, no. 2, pp. 185-198, 2011. · Zbl 1249.65090
[16] F. Ding and T. Chen, “On iterative solutions of general coupled matrix equations,” SIAM Journal on Control and Optimization, vol. 44, no. 6, pp. 2269-2284, 2006. · Zbl 1115.65035
[17] F. Ding and T. Chen, “Iterative least-squares solutions of coupled Sylvester matrix equations,” Systems & Control Letters, vol. 54, no. 2, pp. 95-107, 2005. · Zbl 1129.65306
[18] F. Ding and T. Chen, “Gradient based iterative algorithms for solving a class of matrix equations,” IEEE Transactions on Automatic Control, vol. 50, no. 8, pp. 1216-1221, 2005. · Zbl 1365.65083
[19] F. Ding, P. X. Liu, and J. Ding, “Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle,” Applied Mathematics and Computation, vol. 197, no. 1, pp. 41-50, 2008. · Zbl 1143.65035
[20] F. Ding and T. Chen, “Gradient-based identification methods for Hammerstein nonlinear ARMAX models,” Nonlinear Dynamics, vol. 45, no. 1-2, pp. 31-43, 2006. · Zbl 1134.93321
[21] F. Ding and T. Chen, “Gradient and least-squares based identification methods for OE and OEMA systems,” Digital Signal Processing, vol. 20, no. 3, pp. 664-677, 2010.
[22] Y. J. Liu, J. Sheng, and R. F. Ding, “Convergence of stochastic gradient estimation algorithm for multivariable ARX-like systems,” Computers & Mathematics with Applications, vol. 59, no. 8, pp. 2615-2627, 2010. · Zbl 1193.60057
[23] Y. J. Liu, Y. S. Xiao, and X. L. Zhao, “Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model,” Applied Mathematics and Computation, vol. 215, no. 4, pp. 1477-1483, 2009. · Zbl 1177.65095
[24] F. Ding, G. J. Liu, and X. P. Liu, “Parameter estimation with scarce measurements,” Automatica, vol. 47, no. 8, pp. 1646-1655, 2011. · Zbl 1232.62043
[25] F. Ding and T. W. Chen, “Performance analysis of multi-innovation gradient type identification methods,” Automatica, vol. 43, no. 1, pp. 1-14, 2007. · Zbl 1140.93488
[26] F. Ding, Y. J. Liu, and B. Bao, “Gradient based and least squares based iterative estimation algorithms for multi-input multi-output systems,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 226, no. 1, pp. 43-55, 2012.
[27] M. Y. Waziri, W. J. Leong, and M. Mamat, “A two-step matrix-free secant method for solving large-scale systems of nonlinear equations,” Journal of Applied Mathematics, vol. 2012, Article ID 348654, 9 pages, 2012. · Zbl 1247.65068
[28] L. A. Hageman and D. M. Young, Applied Iterative Methods, Academic Press, New York, NY, USA, 1981. · Zbl 0459.65014
[29] R. S. Varga, Matrix Iterative Analysis, Springer, Berlin, Germany, 2nd edition, 2000. · Zbl 0998.65505
[30] The MathWorks, Inc. MATLAB 7, September 2004.
[31] Y. Saad, Iterative Methods for Sparse Linear Systems, PWS, Boston, Mass, USA, 1996. · Zbl 1031.65047
[32] A. Bouhamidi and K. Jbilou, “A note on the numerical approximate solutions for generalized Sylvester matrix equations with applications,” Applied Mathematics and Computation, vol. 206, no. 2, pp. 687-694, 2008. · Zbl 1162.65019
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.