Wasserstein loss for image synthesis and restoration.

*(English)*Zbl 1358.90102##### Keywords:

optimal transport; Wasserstein loss; total variation; generalized Gaussian distributions; denoising; inpainting; impulse noise removal
PDF
BibTeX
XML
Cite

\textit{G. Tartavel} et al., SIAM J. Imaging Sci. 9, No. 4, 1726--1755 (2016; Zbl 1358.90102)

Full Text:
DOI

##### References:

[1] | C. Aguerrebere, Y. Gousseau, and G. Tartavel, Exemplar-based texture synthesis: The Efros-Leung algorithm, Image Process. On Line, 3 (2013), pp. 223–241, . |

[2] | P. Arias, G. Facciolo, V. Caselles, and G. Sapiro, A variational framework for exemplar-based image inpainting, Int. J. Computer Vision, 93 (2011), pp. 319–347, . · Zbl 1235.94015 |

[3] | J.-F. Aujol, G. Aubert, L. Blanc-Féraud, and A. Chambolle, Image decomposition into a bounded variation component and an oscillating component, J. Math. Imaging Vision, 22 (2005), pp. 71–88, . · Zbl 1371.94031 |

[4] | S. P. Awate and R. T. Whitaker, Unsupervised, information-theoretic, adaptive image filtering for image restoration, Trans. Pattern Anal. Machine Intell., 28 (2006), pp. 364–376, . |

[5] | A. Beck and M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, J. Imaging Sci., 2 (2009), pp. 183–202, . · Zbl 1175.94009 |

[6] | P. Blomgren, T. F. Chan, P. Mulet, and C.-K. Wong, Total variation image restoration: Numerical methods and extensions, in Proceedings of the International Conference on Image Processing (ICIP), IEEE, Piscataway, NJ, 1997, pp. 384–384, . |

[7] | N. Bonneel, J. Rabin, G. Peyré, and H. Pfister, Sliced and radon Wasserstein barycenters of measures, J. Math. Imaging Vision, 51 (2015), pp. 22–45, . · Zbl 1332.94014 |

[8] | H. Bristow, A. Eriksson, and S. Lucey, Fast convolutional sparse coding, in Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Piscataway, NJ, 2013, pp. 391–398, . |

[9] | A. Buades, B. Coll, and J.-M. Morel, A non-local algorithm for image denoising, in Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Piscataway, NJ, 2005, pp. 60–65, . · Zbl 1108.94004 |

[10] | S. S. Chen, D. L. Donoho, and M. A. Saunders, Atomic decomposition by basis pursuit, J. Sci. Comput., 20 (1998), pp. 33–61, . · Zbl 0919.94002 |

[11] | T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, and W. T. Freeman, Image restoration by matching gradient distributions, Trans. Pattern Anal. Machine Intell., 34 (2012), pp. 683–694, . |

[12] | W. Cho, S. C. Seo, and J. You, Edge-preserving denoising method using variation approach and gradient distribution, in Proceedings of the International Conference on Big Data and Smart Computing (BIGCOMP), IEEE Computer Society Press, Piscataway, NJ, 2014, pp. 139–144, . |

[13] | R. R. Coifman and D. L. Donoho, Translation-invariant de-noising, in Wavelets and Statistics, Lecture Notes in Statistics 103, Springer, New York, 1995, pp. 125–150, . · Zbl 0866.94008 |

[14] | L. Condat, A primal–dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms, J. Optim. Theory Appl., 158 (2013), pp. 460–479, . · Zbl 1272.90110 |

[15] | L. Condat and A. Hirabayashi, Cadzow denoising upgraded: A new projection method for the recovery of DIRAC pulses from noisy linear measurements, Sampling Theory Signal Image Process., 14 (2015), pp. 17–47. · Zbl 1346.94023 |

[16] | K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, Image denoising by sparse \(3\)-d transform-domain collaborative filtering, Trans. Image Process., 16 (2007), pp. 2080–2095, . |

[17] | C.-A. Deledalle, S. Vaiter, J. Fadili, and G. Peyré, Stein unbiased gradient estimator of the risk (SUGAR) for multiple parameter selection, SIAM J. Imaging Sci., 7 (2014), pp. 2448–2487, . · Zbl 1361.94012 |

[18] | D. L. Donoho and J. M. Johnstone, Ideal spatial adaptation by wavelet shrinkage, Biometrika, 81 (1994), pp. 425–455, . · Zbl 0815.62019 |

[19] | A. A. Efros and T. K. Leung, Texture synthesis by non-parametric sampling, in Proceedings of the International Conference on Computer Vision (ICCV), IEEE, Piscataway, NJ, 1999, pp. 1033–1038, . |

[20] | M. El Gheche, J.-F. Aujol, Y. Berthoumieu, and C.-A. Deledalle, Texture Reconstruction Guided by the Histogram of a High-Resolution Patch, Technical Report HAL-01276582, 2016. · Zbl 1409.94139 |

[21] | M. Elad and M. Aharon, Image denoising via learned dictionaries and sparse representation, in Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Piscataway, NJ, 2006, pp. 895–900, . |

[22] | M. Elad, P. Milanfar, and R. Rubinstein, Analysis versus synthesis in signal priors, Inverse Problems, 23 (2007), pp. 947–968, . · Zbl 1138.93055 |

[23] | A. Elmoataz, O. Lezoray, and S. Bougleux, Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing, Trans. Image Process., 17 (2008), pp. 1047–1060, . · Zbl 1143.94308 |

[24] | K. Engan, S. O. Aase, and J. Hakon Husoy, Method of optimal directions for frame design, in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Piscataway, NJ, 1999, pp. 2443–2446, . |

[25] | S. Ferradans, N. Papadakis, G. Peyré, and J.-F. Aujol, Regularized discrete optimal transport, SIAM J. Imaging Sci., 7 (2014), pp. 1853–1882, . · Zbl 1308.90128 |

[26] | B. Galerne, Y. Gousseau, and J.-M. Morel, Random phase textures: Theory and synthesis, Trans. Image Process., 20 (2011), pp. 257–267, . · Zbl 1372.94086 |

[27] | B. Galerne, A. Lagae, S. Lefebvre, and G. Drettakis, Gabor noise by example, Trans. Graphics, 31 (2012), 73, . |

[28] | L. A. Gatys, A. S. Ecker, and M. Bethge, Texture synthesis using convolutional neural networks, in Proceedings of the 28th International Conference on Neural Information Processing Systems, Adv. Neural Inform. Process. Syst. 28, MIT Press, Cambridge, MA, 2015, pp. 262–270. |

[29] | G. Gilboa and S. Osher, Nonlocal operators with applications to image processing, Multiscale Model. Simul., 7 (2008), pp. 1005–1028, . · Zbl 1181.35006 |

[30] | Y. Gong and I. F. Sbalzarini, A natural-scene gradient distribution prior and its application in light-microscopy image processing, IEEE J. Sel. Topics Signal Process., 10 (2016), pp. 99–114, . |

[31] | R. Gribonval, V. Cevher, and M. E. Davies, Compressible distributions for high-dimensional statistics, Trans. Inform. Theory, 58 (2012), pp. 5016–5034, . · Zbl 1364.62184 |

[32] | F. Guichard and F. Malgouyres, Total variation based interpolation, in Proceedings of the European Signal Processing Conference (EUSIPCO), IEEE, Piscataway, NJ, 1998, pp. 1741–1744. |

[33] | D. J. Heeger and J. R. Bergen, Pyramid-based texture analysis/synthesis, in Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’95), ACM, New York, 1995, pp. 229–238, . |

[34] | V. Kwatra, I. Essa, A. Bobick, and N. Kwatra, Texture optimization for example-based synthesis, Trans. Graphics, 24 (2005), pp. 795–802, . |

[35] | M. Lebrun, A. Buades, and J.-M. Morel, Implementation of the “Non-Local Bayes” (NL-Bayes) image denoising algorithm, Image Processing On Line, 3 (2013), pp. 1–42, . |

[36] | M. Lebrun, A. Buades, and J.-M. Morel, A nonlocal Bayesian image denoising algorithm, J. Imaging Sci., 6 (2013), pp. 1665–1688, . · Zbl 1279.68331 |

[37] | S. Lefebvre and H. Hoppe, Parallel controllable texture synthesis, Trans. Graphics, 24 (2005), pp. 777–786, . |

[38] | E. Levina and P. J. Bickel, Texture synthesis and nonparametric resampling of random fields, Ann. Statist., 34 (2006), pp. 1751–1773, . · Zbl 1246.62194 |

[39] | A. S. Lewis and M. L. Overton, Nonsmooth optimization via quasi-Newton methods, Math. Program., 141 (2013), pp. 135–163, . · Zbl 1280.90118 |

[40] | C. Louchet and L. Moisan, Posterior expectation of the total variation model: Properties and experiments, J. Imaging Sci., 6 (2013), pp. 2640–2684, . · Zbl 1279.68333 |

[41] | D. G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Computer Vision, 60 (2004), pp. 91–110, . |

[42] | Y. Lu, S.-c. Zhu, and Y. N. Wu, Learning frame models using CNN filters, in Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, AAAI, Palo Alto, CA, 2016. |

[43] | J. Mairal, F. Bach, J. Ponce, and G. Sapiro, Online learning for matrix factorization and sparse coding, J. Machine Learning Res., 11 (2010), pp. 19–60. · Zbl 1242.62087 |

[44] | S. Mallat, A theory for multiresolution signal decomposition: The wavelet representation, Trans. Pattern Anal. Machine Intell., 11 (1989), pp. 674–693, . · Zbl 0709.94650 |

[45] | M. Nikolova, Model distortions in Bayesian MAP reconstruction, Inverse Problems and Imaging, 1 (2007), pp. 399–422. · Zbl 1115.62032 |

[46] | J. Nocedal, Updating quasi-Newton matrices with limited storage, Math. Comput., 35 (1980), pp. 773–782, . · Zbl 0464.65037 |

[47] | B. A. Olshausen and D. J. Field, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, 381 (1996), pp. 607–609, . |

[48] | G. Peyré, S. Bougleux, and L. D. Cohen, Non-local regularization of inverse problems, Inverse Problems and Imaging, 5 (2011), pp. 511–530, . · Zbl 1223.68116 |

[49] | J. Portilla and E. P. Simoncelli, A parametric texture model based on joint statistics of complex wavelet coefficients, Int. J. Computer Vision, 40 (2000), pp. 49–70, . · Zbl 1012.68698 |

[50] | J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, Image denoising using scale mixtures of Gaussians in the wavelet domain, Trans. Image Process., 12 (2003), pp. 1338–1351, . · Zbl 1279.94028 |

[51] | M. J. D. Powell, Some global convergence properties of a variable metric algorithm for minimization without exact line searches, Nonlinear Programming, 9 (1976), pp. 53–72. |

[52] | J. Rabin and G. Peyré, Wasserstein regularization of imaging problem, in Proceedings of the International Conference on Image Processing (ICIP), IEEE, Piscataway, NJ, 2011, pp. 1541–1544, . |

[53] | J. Rabin, G. Peyré, J. Delon, and M. Bernot, Wasserstein barycenter and its application to texture mixing, in Proceedings of the Conference on Scale Space and Variational Methods in Computer Vision (SSVM’12), 6667 (2012), pp. 435–446, . |

[54] | J. K. Romberg, H. Choi, and R. G. Baraniuk, Bayesian tree-structured image modeling using wavelet-domain hidden Markov models, Trans. Image Process., 10 (2001), pp. 1056–1068, . |

[55] | S. Roth and M. J. Black, Fields of experts: A framework for learning image priors, in Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Piscataway, NJ, 2005, pp. 860–867, . |

[56] | L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259–268, . · Zbl 0780.49028 |

[57] | E. P. Simoncelli, Bayesian denoising of visual images in the wavelet domain, in Bayesian Inference in Wavelet-Based Models, Lecture Notes in Statistics 141, Springer, New York, 1999, pp. 291–308, . · Zbl 1115.62314 |

[58] | E. P. Simoncelli and E. H. Adelson, Noise removal via Bayesian wavelet coring, in Proceedings of the International Conference on Image Processing (ICIP), IEEE, Piscataway, NJ, 1996, pp. 379–382, . |

[59] | A. Stuart, Inverse problems: A Bayesian perspective, Acta Numer., 19 (2010), pp. 451–559, . · Zbl 1242.65142 |

[60] | P. Swoboda and C. Schnörr, Convex variational image restoration with histogram priors, J. Imaging Sci., 6 (2013), pp. 1719–1735, . · Zbl 1281.65041 |

[61] | G. Tartavel, Variational Models for Textures: Applications to Synthesis and Restoration, Ph.D. thesis, Telecom ParisTech, 2015. |

[62] | G. Tartavel, Y. Gousseau, and G. Peyré, Constrained sparse texture synthesis, in Proceedings of the International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), Lecture Notes in Comput. Sci. 7893, Springer, New York, 2013, pp. 186–197, . |

[63] | G. Tartavel, Y. Gousseau, and G. Peyré, Variational texture synthesis with sparsity and spectrum constraints, J. Math. Imaging and Vision, 52 (2014), pp. 124–144, . · Zbl 1332.62371 |

[64] | R. Tibshirani, Regression shrinkage and selection via the lasso, J. Roy. Statist. Soc. Ser. B, 58 (1996), pp. 267–288. · Zbl 0850.62538 |

[65] | G. Van de Wouwer, P. Scheunders, and D. Van Dyck, Statistical texture characterization from discrete wavelet representations, Proc. IEEE Trans. Image Process., 8 (1999), pp. 592–598, . |

[66] | C. Villani, Topics in Optimal Transportation, Grad. Stud. Math., American Mathematical Society, Providence, RI, 2003. · Zbl 1106.90001 |

[67] | Y.-Q. Wang, The implementation of SURE guided piecewise linear image denoising, Image Processing On Line, 3 (2013), pp. 43–67, . |

[68] | L.-Y. Wei and M. Levoy, Fast texture synthesis using tree-structured vector quantization, in Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’00), ACM, New York, 2000, pp. 479–488, . |

[69] | J. Weickert, Anisotropic Diffusion in Image Processing, Teubner-Verlag, Berlin, 1998. · Zbl 0886.68131 |

[70] | O. J. Woodford, C. Rother, and V. Kolmogorov, A global perspective on map inference for low-level vision, in Proceedings of the International Conference on Computer Vision (ICCV), IEEE, Piscataway, NJ, 2009, pp. 2319–2326, . |

[71] | G. Yu, G. Sapiro, and S. Mallat, Solving inverse problems with piecewise linear estimators: From Gaussian mixture models to structured sparsity, Trans. Image Process., 21 (2012), pp. 2481–2499, . · Zbl 1373.94471 |

[72] | Q. Zhu and L. Sun, An improved non-blind image deblurring methods based on foes, in Proceedings of the International Conference on Machine Vision (ICMV), SPIE, Bellingham, WA, 2013, 87830G–6, . |

[73] | S.-C. Zhu, Y. Wu, and D. Mumford, Filters, random fields and maximum entropy (FRAME): Towards a unified theory for texture modeling, Int. J. Computer Vision, 27 (1998), pp. 107–126, . |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.