×

zbMATH — the first resource for mathematics

On the discrepancy principle for stochastic gradient descent. (English) Zbl 07252746
MSC:
47A General theory of linear operators
62G Nonparametric inference
47N Miscellaneous applications of operator theory
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Blanchard G and Mathé P 2012 Discrepancy principle for statistical inverse problems with application to conjugate gradient iteration Inverse Problems28 115011 · Zbl 1284.47051
[2] Bottou L 2010 Large-scale machine learning with stochastic gradient descent Proc. of COMPSTAT’2010 (Berlin: Springer) pp 177-86 · Zbl 1436.68293
[3] Bottou L, Curtis F E and Nocedal J 2018 Optimization methods for large-scale machine learning SIAM Rev.60 223-311 · Zbl 1397.65085
[4] Engl H W, Hanke M and Neubauer A 1996 Regularization of Inverse Problems (Dordrecht: Kluwer)
[5] Feller W 1968 An Introduction to Probability Theory and its Applications Vol I 3rd edn (New York: Wiley) · Zbl 0155.23101
[6] Gordon R, Bender R and Herman G T 1970 Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and x-ray photography J. Theor. Biol.29 471-81
[7] Hansen P C 2007 Regularization tools version 4.0 for Matlab 7.3 Numer. Algorithms46 189-94 · Zbl 1128.65029
[8] Harrach B, Jahn T and Potthast R 2020 Beyond the Bakushinskii veto: regularising linear inverse problems without knowing the noise distribution Numer. Math.145 581-603 · Zbl 07218375
[9] Ito K and Jin B 2015 Inverse Problems: Tikhonov Theory and Algorithms (Singapore: World Scientific)
[10] Jin B and Lu X 2019 On the regularizing property of stochastic gradient descent Inverse Problems35 015004 · Zbl 07000893
[11] Jin B, Zhou Z and Zou J 2020 On the convergence of stochastic gradient descent for nonlinear ill-posed problems SIAM J. Optim.30 1421-50 · Zbl 07202491
[12] Johnson R and Zhang T 2013 Accelerating stochastic gradient descent using predictive variance reduction NIPS’13 ed C J C Burges, L Bottou, M Welling, Z Ghahramani and K Q Weinberger pp 315-23
[13] Kaltenbacher B, Neubauer A and Scherzer O 2008 Iterative Regularization Methods for Nonlinear Ill-Posed Problems (Berlin: Walter de Gruyter GmbH) · Zbl 1145.65037
[14] Kluth T and Jin B 2019 Enhanced reconstruction in magnetic particle imaging by whitening and randomized SVD approximation Phys. Med. Biol.64 125026
[15] Kushner H J and Yin G G 2003 Stochastic Approximation and Recursive Algorithms and Applications 2nd edn (New York: Springer)
[16] Landweber L 1951 An iteration formula for Fredholm integral equations of the first kind Am. J. Math.73 615-24 · Zbl 0043.10602
[17] Morozov V A 1966 On the solution of functional equations by the method of regularization Sov. Math. Dokl.7 414-7 · Zbl 0187.12203
[18] Natterer F and Teubner B G 1986 The Mathematics of Computerized Tomography (New York: Wiley)
[19] Robbins H and Monro S 1951 A stochastic approximation method Ann. Math. Stat.22 400-7 · Zbl 0054.05901
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.