×

zbMATH — the first resource for mathematics

Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). (English) Zbl 1081.68732
Summary: This paper describes a novel inpainting algorithm that is capable of filling in holes in overlapping texture and cartoon image layers. This algorithm is a direct extension of a recently developed sparse-representation-based image decomposition method called MCA (morphological component analysis), designed for the separation of linearly combined texture and cartoon layers in a given image [see J.-L. Starck, M. Elad and D. L. Donoho, “Image decomposition via the combination of sparse representations and a variational approach”, IEEE Trans. Image Process. (2004) and “Redundant multiscale transforms and their application for morphological component analysis”, Adv. Imag. Electron Phys. (2004)]. In this extension, missing pixels fit naturally into the separation framework, producing separate layers as a by-product of the inpainting process. As opposed to the inpainting system proposed by Bertalmio et al., where image decomposition and filling-in stages were separated as two blocks in an overall system, the new approach considers separation, hole-filling, and denoising as one unified task. We demonstrate the performance of the new approach via several examples.

MSC:
68U10 Computing methodologies for image processing
94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
65D18 Numerical aspects of computer graphics, image analysis, and computational geometry
92C55 Biomedical imaging and signal processing
68W05 Nonnumerical algorithms
Software:
PDCO
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] J.F. Aujol, G. Aubert, L. Blanc-Feraud, A. Chambolle, Image decomposition: Application to textured images and SAR images, Technical Report ISRN I3S/RR-2003-01-FR, INRIA—Project ARIANA, Sophia Antipolis, 2003 · Zbl 1067.68719
[2] Bertalmio, M.; Vese, L.; Sapiro, G.; Osher, S., Simultaneous structure and texture image inpainting, IEEE trans. image process., 12, 882-889, (2003)
[3] J.S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images, in: Proceedings of SIGGRAPH, 1997
[4] Bruce, A.G.; Sardy, S.; Tseng, P., Block coordinate relaxation methods for nonparametric signal de-noising, (), 75-86
[5] Bruckstein, A.M.; Elad, M., A generalized uncertainty principle and sparse representation in pairs of \(\mathbf{r}^n\) bases, IEEE trans. inform. theory, 48, 2558-2567, (2002) · Zbl 1062.15001
[6] Caselles, V.; Sapiro, G.; Ballester, C.; Bertalmio, M.; Verdera, J., Filling-in by joint interpolation of vector fields and grey levels, IEEE trans. image process., 10, 1200-1211, (2001) · Zbl 1037.68771
[7] Chan, T.; Shen, J., Local inpainting models and TV inpainting, SIAM J. appl. math., 62, 1019-1043, (2001)
[8] Chen, S.S.; Donoho, D.L.; Saunder, M.A., Atomic decomposition by basis pursuit, SIAM J. sci. comput., 33-61, (1998)
[9] Donoho, D.; Huo, X., Uncertainty principles and ideal atomic decomposition, IEEE trans. inform. theory, 47, 7, 2845-2862, (2001) · Zbl 1019.94503
[10] Donoho, D.L.; Elad, M., Optimally sparse representation in general (non-orthogonal) dictionaries via \(\ell^1\) minimization, Proc. natl. acad. sci., 100, 2197-2202, (2003) · Zbl 1064.94011
[11] D.L. Donoho, M. Elad, V. Temlyakov, Stable recovery of sparse overcomplete representations in the presence of noise, IEEE Trans. Inform. Theory (2004), in press · Zbl 1288.94017
[12] Donoho, D.L.; Huo, X., Uncertainty principles and ideal atomic decomposition, IEEE trans. inform. theory, 47, 2845-2862, (2001) · Zbl 1019.94503
[13] A.A. Efros, T.K. Leung, Texture synthesis by non-parametric sampling, in: IEEE International Conference on Computer Vision, Corfu, Greece, September 1999, pp. 1033-1038
[14] Elad, M.; Bruckstein, A.M., A generalized uncertainty principle and sparse representation in pairs of bases, IEEE trans. inform. theory, 48, 2558-2567, (2002) · Zbl 1062.15001
[15] Fuchs, J.-J., On sparse representations in arbitrary redundant bases, IEEE trans. inform. theory, 50, 6, 1341-1344, (2004) · Zbl 1284.94018
[16] Gribonval, R.; Nielsen, M., Some remarks on nonlinear approximation with Schauder bases, East J. approx., 7, 2, 267-285, (2001) · Zbl 1090.41510
[17] Gribonval, R.; Nielsen, M., Sparse representations in unions of bases, IEEE trans. inform. theory, 49, 12, 3320-3325, (2003) · Zbl 1286.94032
[18] O.G. Guleryuz, Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising: Part I—Theory, IEEE Trans. Image Process. (2004), submitted for publication
[19] O.G. Guleryuz, Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising: Part II—Adaptive algorithms, IEEE Trans. Image Process. (2004), submitted for publication
[20] A.L. Bertozzi, M. Bertalmio, G. Sapiro, Navier-Stokes fluid dynamics and image and video inpainting, in: Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 2001
[21] V. Caselles, M. Bertalmio, G. Sapiro, C. Ballester, Image inpainting, in: Comput. Graph. (SIGGRAPH 2000), July 2000, pp. 417-424
[22] Meyer, Y., Oscillating patterns in image processing and nonlinear evolution equations, University lecture series, vol. 22, (2001), Amer. Math. Soc.
[23] Rudin, L.I.; Osher, S.; Fatemi, E., Nonlinear total variation noise removal algorithm, Physica D, 60, 259-268, (1992) · Zbl 0780.49028
[24] Starck, J.-L.; Candès, E.; Donoho, D.L., The curvelet transform for image denoising, IEEE trans. image process., 11, 6, 131-141, (2002) · Zbl 1288.94011
[25] J.-L. Starck, M. Elad, D.L. Donoho, Image decomposition via the combination of sparse representations and a variational approach, IEEE Trans. Image Process. (2004), in press · Zbl 1288.94012
[26] Starck, J.-L.; Elad, M.; Donoho, D.L., Redundant multiscale transforms and their application for morphological component analysis, Adv. imag. electron phys., 132, (2004)
[27] T.A. Tropp, Just relax: Convex programming methods for subset selection and sparse approximation, IEEE Trans. Inform. Theory (2004), in press
[28] Vese, L.A.; Osher, S., Modeling textures with total variation minimization and oscillating patterns in image processing, J. sci. comput., 19, 553-577, (2003) · Zbl 1034.49039
[29] L.Y. Wei, M. Levoy, Fast texture synthesis using tree-structured vector quantization, in: Proceedings of SIGGRAPH, 2000
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.