×

zbMATH — the first resource for mathematics

\( \chi^2\) test for total variation regularization parameter selection. (English) Zbl 1448.65028
The author designs a \(\chi^2\) test for TV regularization parameter selection assuming the blurring matrix is full rank. They derive an approach based on the regularized residual, which does not require training data. Numerical experiments are also presented for three different noisy images.
MSC:
65F22 Ill-posedness and regularization problems in numerical linear algebra
62J07 Ridge regression; shrinkage estimators (Lasso)
94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
68U10 Computing methodologies for image processing
65D18 Numerical aspects of computer graphics, image analysis, and computational geometry
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] A. Ali; R. J. Tibshirani, The generalized lasso problem and uniqueness, Electron. J. Stat., 13, 2307-2347 (2019) · Zbl 07080059
[2] S. D. Babacan; R. Molina; A. K. Katsaggelos, Variational Bayesian blind deconvolution using a total variation prior, IEEE Trans. Image Process., 18, 12-26 (2009) · Zbl 1371.94479
[3] T. Blu; F. Luisier, The SURE-LET approach to image denoising, IEEE Trans. Image Process., 16, 2778-2786 (2007)
[4] G. Casella and R. L. Berger, Statistical Inference, \(2^{nd}\) edition Duxbury, 2001. · Zbl 0699.62001
[5] J. M. Bioucas-Dias, M. A. T. Figueiredo and J. P. Oliveira, Adaptive total variation image deconvolution: A majorization-minimization approach, \(14^{th }\) European Signal Processing Conference, (2006), 1-4.
[6] S. H. Chan; R. Khoshabeh; K. B. Gibson; P. E. Gill; T. Q. Nguyen, An augmented Lagrangian method for total variation video restoration, IEEE Trans. Image Process., 20, 3097-3111 (2011) · Zbl 1372.94034
[7] J. Dahl; P. C. Hansen; S. H. Jensen; T. L. Jensen, Algorithms and software for total variation image reconstruction via first-order methods, Numer. Algorithms, 53, 67-92 (2010) · Zbl 1181.94009
[8] C.-A. Deledalle; S. Vaiter; J. Fadili; G. Peyré, Stein Unbiased GrAdient estimator of the Risk (SUGAR) for multiple parameter selection, SIAM J. Imaging. Sci., 7, 2448-2487 (2014) · Zbl 1361.94012
[9] J. C. De los Reyes; C.-B. Schönlieb, Image denoising: Learning the noise model via nonsmooth PDE-constrained optimization, Inverse Probl. Imaging, 7, 1183-1214 (2013) · Zbl 1283.49005
[10] N. Dey; L. Blanc-Feraud; C. Zimmer; P. Roux; Z. Kam; J.-C. Olivo-Marin; J. Zerubia, Richardson-Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution, Microsc. Res. Tech., 69, 260-266 (2006)
[11] Y. Dong; M. Hintermüller; M. M. Rincon-Camacho, Automated regularization parameter selection in multi-scale total variation models for image restoration, J. Math. Imaging Vision, 40, 82-104 (2011) · Zbl 1255.68230
[12] C. Dossal; M. Kachour; M. J. Fadili; G. Peyré; C. Chesneau, The degrees of freedom of the lasso for general design matrix, Statist. Sinica, 23, 809-828 (2013) · Zbl 1433.62193
[13] B. Efron; T. Hastie; I. Johnstone; R. Tibshirani, Least angle regression, Ann. Statist., 32, 407-499 (2004) · Zbl 1091.62054
[14] P. Getreuer, Rudin-Osher-Fatemi total variation denoising using Split Bregman, Image Processing On Line, 2, 74-95 (2012)
[15] M. L. Green, Statistics of Images, the TV Algorithm of Rudin-Osher-Fatemi for Image Denoising and an Improved Denoising Algorithm, UCLA CAM 02-55, 2002.
[16] T. Goldstein; S. Osher, The split Bregman method for \(L^1\)-regularized problems, SIAM J. Imaging Sci., 2, 323-343 (2009) · Zbl 1177.65088
[17] P. Hall; D. M. Titterington, Common structure of techniques for choosing smoothing parameters in regression problems, J. Roy. Statist. Soc. Ser. B, 49, 184-198 (1987) · Zbl 0633.62063
[18] P. C. Hansen, J. G. Nagy and D. P. O’Leary, Deblurring Images: Matrices, Spectra and Filtering, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2006.
[19] P. C. Hansen, Regularization tools version 4.0 for Matlab 7.3, Numer. Algorithms, 46, 189-194 (2007) · Zbl 1128.65029
[20] M. Hintermüller; C. N. Rautenberg, Optimal selection of the regularization function in a weighted total variation model. Part I: Modelling and theory, J. Math. Imaging Vision, 59, 498-514 (2017) · Zbl 1382.94015
[21] M. Hintermüller; C. N. Rautenberg; T. Wu; A. Langer, Optimal selection of the regularization function in a weighted total variation model. Part II: Algorithm, its analysis and numerical tests, J. Math. Imaging Vision, 59, 515-533 (2017) · Zbl 1382.94016
[22] J. Huang; D. Mumford, Statistics of natural images and models, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1, 541-547 (1999)
[23] H. Liao; F. Li; M. K. Ng, Section of regularization parameter in total variation image restoration, J. Opt. Soc. Amer. A, 26, 2311-2320 (2009)
[24] S. Kotz, T. J. Kozubowski and K. Podgórski, The Laplace Distribution and Generalizations. A Revisit with Applications to Communications, Economics, Engineering, and Finance, Birkhäuser Boston, Inc., Boston, MA, 2001. · Zbl 0977.62003
[25] K. Kunisch; T. Pock, A bilevel Optimization approach for parameter learning in variational models, SIAM J. Imaging Sci., 6, 938-983 (2013) · Zbl 1280.49053
[26] A. Langer, Automated parameter selection for total variation minimization in image restoration, J. Math. Imaging Vision, 57, 239-268 (2017) · Zbl 1369.94030
[27] J. Lee; P. K. Kitanidis, Bayesian inversion with total variation prior for discrete geologic structure identification, Water Resour. Res., 49, 7658-7669 (2013)
[28] Y. Lin; B. Wohlberg; H. Guo, UPRE method for total variation parameter selection, Signal Processing, 90, 2546-2551 (2010) · Zbl 1194.94109
[29] D. W. Marquardt, Generalized inverses, ridge regression, biased linear estimation, and nonlinear estimation, Technometrics, 12, 591-612 (1970) · Zbl 0205.46102
[30] J. L. Mead, A priori weighting for parameter estimation, J. Inverse Ill-Posed Probl., 16, 175-193 (2008) · Zbl 1156.65008
[31] J. L. Mead and R. A. Renaut, A Newton root-finding algorithm for estimating the regularization parameter for solving ill-conditioned least squares problems, Inverse Problems, 25 (2009), 025002. · Zbl 1163.65019
[32] J. L. Mead; R. A. Renaut, Least squares problems with inequality constraints as quadratic constraints, Linear Algebra Appl., 432, 1936-1949 (2010) · Zbl 1185.65068
[33] J. L. Mead, Discontinuous parameter estimates with least squares estimators, Appl. Math. Comput., 219, 5210-5223 (2013) · Zbl 1282.65047
[34] J. L. Mead; C. C. Hammerquist, \( \chi^2\) tests for the choice of the regularization parameter in nonlinear inverse problems, SIAM J. Matrix Anal. Appl., 34, 1213-1230 (2013) · Zbl 1305.62235
[35] V. A. Morozov, Methods for Solving Incorrectly Posed Problems, Translated from the Russian by A. B. Aries, translation edited by Z. Nashed, Springer-Verlag, New York, 1984.
[36] M. K. Ng; P. Weiss; X. Yuan, Solving Constrained total-variation image restoration and reconstruction problems via alternating direction methods, SIAM J. Sci. Comput., 32, 2710-2736 (2010) · Zbl 1217.65071
[37] J. P. Oliveira; J. M. Bioucas-Dias; M. A. T. Figueiredo, Adaptive total variation image deblurring: A majorization-minimization approach, Signal Processing, 89, 1683-1693 (2009) · Zbl 1178.94029
[38] L. I. Rudin; S. Osher; E. Fatemi, Nonlinear total variation based noise removal algorithms. Experimental mathematics: Computational issues in nonlinear science, Phys. D, 60, 259-268 (1992) · Zbl 0780.49028
[39] A. Srivastava; A. B. Lee; E. P. Simoncelli; S.-C. Zhu, On advances in statistical modeling of natural images, J. Math. Imaging Vision, 18, 17-33 (2003) · Zbl 1033.68133
[40] T. Teuber, G. Steidl and R. H. Chan, Minimization and parameter estimation for seminorm regularization models with \(I\)-divergence constraints, Inverse Problems, 29 (2013), 035007, 28 pp. · Zbl 1267.65046
[41] R. J. Tibshirani; J. Taylor, The solution path of the generalized lasso, Ann. Statist., 39, 1335-1371 (2011) · Zbl 1234.62107
[42] R. J. Tibshirani; J. Taylor, Degrees of freedom in lasso problems, Ann. Statist., 40, 1198-1232 (2012) · Zbl 1274.62469
[43] D. M. Titterington, Choosing the regularization parameter in image restoration, IMS Lecture Notes Monogr. Ser., 20, 392-402 (1991)
[44] G. Wahba, Bayesian “confidence intervals” for the cross-validated smoothing spline, J. Roy. Statist. Soc. Ser. B, 45, 133-150 (1983) · Zbl 0538.65006
[45] Y. Wang; J. Yang; W. Yin; Y. Zhang, A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci., 1, 248-272 (2008) · Zbl 1187.68665
[46] Y.-W. Wen; R. H. Chan, Parameter selection for total-variation-based image restoration using discrepancy principle, IEEE Trans. Image Process., 21, 1770-1781 (2012) · Zbl 1373.94440
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.