Energy-driven image interpolation using Gaussian process regression. (English) Zbl 1251.94011

Summary: Image interpolation, as a method of obtaining a high-resolution image from the corresponding low-resolution image, is a classical problem in image processing. In this paper, we propose a novel energy-driven interpolation algorithm employing Gaussian process regression. In our algorithm, each interpolated pixel is predicted by a combination of two information sources: first is a statistical model adopted to mine underlying information, and second is an energy computation technique used to acquire information on pixel properties. We further demonstrate that our algorithm can not only achieve image interpolation, but also reduce noise in the original image. Our experiments show that the proposed algorithm can achieve encouraging performance in terms of image visualization and quantitative measures.


94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
62B15 Theory of statistical experiments
Full Text: DOI


[1] P. Thevenaz, T. Blu, and M. Unser, “Interpolation revisited,” IEEE Transactions on Medical Imaging, vol. 19, no. 7, pp. 739-758, 2000.
[2] K. S. Ni and T. Q. Nguyen, “An adaptable k-nearest neighbors algorithm for MMSE image interpolation,” IEEE Transactions on Image Processing, vol. 18, no. 9, pp. 1976-1987, 2009. · Zbl 1371.94275
[3] Z. Hou and Q. Zhang, “Interpolation algorithm for recovering the missing phase values in 3D measurement,” Optik, vol. 121, no. 14, pp. 1324-1329, 2010.
[4] J. W. Han, J. H. Kim, S. H. Cheon, J. O. Kim, and S. J. Ko, “A novel image interpolation method using the bilateral filter,” IEEE Transactions on Consumer Electronics, vol. 56, no. 1, pp. 175-181, 2010.
[5] T. Nagata, “Smooth local interpolation of surfaces using normal vectors,” Journal of Applied Mathematics, vol. 2010, Article ID 952420, 24 pages, 2010. · Zbl 1205.65042
[6] Y. W. Tai, S. Liu, M. S. Brown, and S. Lin, “Super resolution using edge prior and single image detail synthesis,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR ’10), pp. 2400-2407, June 2010.
[7] W. S. Tam, C. W. Kok, and W. C. Siu, “Modified edge-directed interpolation for images,” Journal of Electronic Imaging, vol. 19, no. 1, Article ID 013011, pp. 1-20, 2010.
[8] J. Sun, J. Sun, Z. Xu, and H. Y. Shum, “Image super-resolution using gradient profile prior,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR ’08), pp. 1-8, June 2008. · Zbl 1372.94242
[9] A. Giachetti and N. Asuni, “Real-time artifact-free image upscaling,” IEEE Transactions on Image Processing, vol. 20, no. 10, pp. 2760-2768, 2011. · Zbl 1372.94089
[10] D. Glasner, S. Bagon, and M. Irani, “Super-resolution from a single image,” in Proceedings of the 12th International Conference on Computer Vision (ICCV ’09), pp. 349-356, October 2009.
[11] K. I. Kim and Y. Kwon, “Example-based learning for single-image super-resolution,” in Proceedings of the 30th DAGM symposium on Pattern Recognition, pp. 456-465, 2008.
[12] R. Fattal, “Image upsampling via imposed edge statistics,” ACM Transactions on Graphics, vol. 26, no. 3, Article ID 1276496, pp. 95-1-95-8, 2007. · Zbl 05457745
[13] H. He and W.-C. Siu, “Single image super-resolution using Gaussian process regression,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR ’11), pp. 449-456, 2011.
[14] H. Asheri, H. R. Rabiee, N. Pourdamghani, and M. H. Rohban, “A gaussian process regression framework for spatial error concealment with adaptive kernels,” in Proceedings of the 20th International Conference on Pattern Recognition (ICPR ’10), pp. 4541-4544, August 2010.
[15] G. Salimi-Khorshidi, T. E. Nichols, S. M. Smith, and M. W. Woolrich, “Using gaussian-process regression for meta-analytic neuroimaging inference based on sparse observations,” IEEE Transactions on Medical Imaging, vol. 30, no. 7, pp. 1401-1416, 2011.
[16] J. Pasi, V. Jarno, and V. Aki, “Robust Gaussian process regression with a student-t likelihood,” Journal of Machine Learning Research, vol. 12, pp. 3227-3257, 2011. · Zbl 1280.60025
[17] L. You, V. Brusic, M. Gallagher, and M. Bodén, “Using Gaussian process with test rejection to detect T-cell epitopes in pathogen genomes,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 7, no. 4, pp. 741-751, 2010.
[18] S. Sun and X. Xu, “Variational inference for infinite mixtures of Gaussian processes with applications to traffic flow prediction,” IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 2, pp. 466-475, 2011.
[19] R. Zimmermann, “Asymptotic behavior of the likelihood function of covariance matrices of spatial Gaussian processes,” Journal of Applied Mathematics, vol. 2010, Article ID 494070, 17 pages, 2010. · Zbl 1205.62141
[20] A. Ranganathan, M.-H. Yang, and J. Ho, “Online sparse Gaussian process regression and its applications,” IEEE Transactions on Image Processing, vol. 20, no. 2, pp. 391-404, 2011. · Zbl 1372.94217
[21] O. Rudovic and M. Pantic, “Shape-constrained Gaussian process regression for facial-point-based head-pose normalization,” in Proceedings of the International Conference on Computer Vision (ICCV ’11), pp. 1495-1502, 2011.
[22] A. M. Feng, L. M. Fang, and M. Lin, “Gaussian process regression and its application in near-infrared spectroscopy analysis,” Spectroscopy and Spectral Analysis, vol. 31, no. 6, pp. 1514-1517, 2011.
[23] M. M. Atia, A. Noureldin, and M. Korenberg, “Gaussian process regression approach for bridging GPS outages in integrated navigation systems,” Electronics Letters, vol. 47, no. 1, pp. 52-53, 2011.
[24] C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning, Adaptive Computation and Machine Learning, MIT Press, Cambridge, Mass, USA, 2006. · Zbl 1177.68165
[25] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, 2004. · Zbl 05453404
[26] J.-W. Roh and B.-K. Yi, “Efficient indexing of interval time sequences,” Information Processing Letters, vol. 109, no. 1, pp. 1-12, 2008. · Zbl 1191.68254
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.