×

A new Kaczmarz-type method and its acceleration for nonlinear ill-posed problems. (English) Zbl 1431.65079

Summary: In this paper, we first introduce a new Kaczmarz-type method for solving inverse problems that can be written as a system of a finite number of nonlinear equations. The proposed homotopy perturbation Kaczmarz (HPK) iteration is seen as a hybrid method between the homotopy perturbation iteration and the Kaczmarz strategy. Furthermore, an accelerated homotopy perturbation Kaczmarz (AHPK) method is presented based on the general case of Nesterov’s acceleration scheme. Under the classical assumptions for iterative regularization methods, we provide the corresponding convergence analysis for HPK and AHPK, respectively. The HPK iteration is shown to have faster calculation speed and less time consumption than the Landweber-Kaczmarz iteration through some numerical experiments on inverse potential problem. Besides, the significantly reduced computation cost and much better reconstruction quality indicate a remarkable acceleration effect for AHPK.

MSC:

65J15 Numerical solutions to equations with nonlinear operators
65J20 Numerical solutions of ill-posed problems in abstract spaces; regularization
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Cheng J and Hofmann B 2011 Regularization Methods for Ill-Posed Problems (New York: Springer) · Zbl 1259.65086 · doi:10.1007/978-0-387-92920-0_3
[2] Seidman T I and Vogel C 1987 Well posedness and convergence of some regularisation methods for non-linear ill posed problems Inverse Problems5 227238
[3] Tikhonov A N 1963 Regularization of incorrectly posed problems Sov. Math.—Dokl.4 1624-7 · Zbl 0183.11601
[4] Leit A and Svaiter B 2016 On projective Landweber-Kaczmarz methods for solving systems of nonlinear ill-posed equations Inverse Problems32 025004 · Zbl 1344.65052 · doi:10.1088/0266-5611/32/2/025004
[5] Baumeister J, Kaltenbacher B and Leit A 2010 On Levenberg-Marquardt-Kaczmarz iterative methods for solving systems of nonlinear ill-posed equations Inverse Problems Imaging4 335350 · Zbl 1208.65071 · doi:10.3934/ipi.2010.4.335
[6] Cezaro A D, Haltmeier M, Leit A and Scherzer O 2008 On steepest-descent-Kaczmarz methods for regularizing systems of nonlinear ill-posed equations Appl. Math. Comput.202 596-607 · Zbl 1157.65032 · doi:10.1016/j.amc.2008.03.010
[7] Li H and Haltmeier M 2018 The averaged Kaczmarz iteration for solving inverse problems SIAM J. Imaging Sci.11 1936-4954 · Zbl 1401.65059 · doi:10.1137/17M1146178
[8] Kaczmarz S 1937 Angenäherte auflösung von systemen linearer Gleichungen Bull. Int. Acad. Pol. Sci. Lett. A 35 355-7 (in German) · Zbl 0017.31703
[9] Haltmeier M, Leit A and Scherzer O 2007 Kaczmarz methods for regularizing nonlinear ill-posed equations. I. Convergence analysis Inverse Problems Imaging1 289-98 · Zbl 1123.65051 · doi:10.3934/ipi.2007.1.289
[10] Haltmeier M, Leit A and Scherzer O 2007 Kaczmarz methods for regularizing nonlinear ill-posed equations. II. Applications Inverse Problems Imaging1 507-23 · Zbl 1135.65026 · doi:10.3934/ipi.2007.1.507
[11] Kowar R and Scherzer O 2002 Convergence analysis of a Landweber-Kaczmarz method for solving nonlinear ill-posed problems J. Inverse Ill-Posed Problems23 69-90 · Zbl 1048.65055
[12] Cao L and Han B 2011 Convergence analysis of the homotopy perturbation method for solving nonlinear ill-posed operator equations Comput. Math. Appl.61 2058-61 · Zbl 1219.65167 · doi:10.1016/j.camwa.2010.08.069
[13] Cao L, Han B and Wang W 2009 Homotopy perturbation method for nonlinear ill-posed operator equations Int. J. Nonlinear Sci. Numer. Simul.10 1319-22 · doi:10.1515/IJNSNS.2009.10.10.1319
[14] Fu H, Cao L and Han B 2012 A homotopy perturbation method for well log constrained seismic waveform inversion Chin. J. Geophys.55 3173-9
[15] Bi B, Han B and Tang J 2014 A homotopy perturbation method for diffuse optical tomography based on radiative transfer equation J. Med. Imaging Health Inf.4 932-6 · doi:10.1166/jmihi.2014.1344
[16] Wang J, Wang W and Han B 2018 An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces (arXiv:1801.02759)
[17] Nesterov Y 1983 A method of solving a convex programming problem with convergence rate O(1/k2) Sov. Math.—Dokl.27 372-6 · Zbl 0535.90071
[18] Attouch H and Peypouquet J 2016 The rate of convergence of Nesterov’s accelerated forward-backward method is actually faster than O(1/k2) SIAM J. Optim.26 1824-34 · Zbl 1346.49048 · doi:10.1137/15M1046095
[19] Hubmer S and Ramlau R 2018 Nesterov’s accelerated gradient method for nonlinear ill-posed problems with a locally convex residual functional Inverse Problems34 095003 · Zbl 06904974 · doi:10.1088/1361-6420/aacebe
[20] Jin Q 2016 Landweber-Kaczmarz method in Banach spaces with inexact inner solvers Inverse Problems32 104005 · Zbl 1356.65146 · doi:10.1088/0266-5611/32/10/104005
[21] Hubmer S and Ramlau R 2017 Convergence analysis of a two-point gradient method for nonlinear ill-posed problems Inverse Problems33 095004 · Zbl 1378.65116 · doi:10.1088/1361-6420/aa7ac7
[22] Zhong M, Wang W and Jin Q 2018 Regularization of inverse problems by two-point gradient methods with convex constraints (arXiv:1812.10645)
[23] Hanke M, Neubauer A and Scherzer O 1995 A convergence analysis of the Landweber iteration for nonlinear ill-posed problems Numer. Math.72 21-37 · Zbl 0840.65049 · doi:10.1007/s002110050158
[24] Engl H W, Hanke M and Neubauer A 1996 Regularization of Inverse Problems (Dordrecht: Kluwer) · doi:10.1007/978-94-009-1740-8
[25] Kaltenbacher B, Neubauer A and Scherzer O 2008 Iterative Regularization Methods for Nonlinear Ill-Posed Problems (Berlin: de Gruyter & Co) · Zbl 1145.65037 · doi:10.1515/9783110208276
[26] Scherzer O 1993 Convergence rates of iterated Tikhonov regularized solutions of nonlinear ill-posed problems Numer. Math.66 259-79 · Zbl 0791.65040 · doi:10.1007/BF01385697
[27] Jin Q and Wang W 2013 Landweber iteration of Kaczmarz type with general non-smooth convex penalty functionals Inverse Problems29 1400-16 · Zbl 1283.65056 · doi:10.1088/0266-5611/29/8/085011
[28] Burger M and Kaltenbacher B 2006 Regularizing Newton-Kaczmarz methods for nonlinear ill-posed problems SIAM J. Numer. Anal.44 153-82 · Zbl 1112.65049 · doi:10.1137/040613779
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.