zbMATH — the first resource for mathematics

Texture synthesis and nonparametric resampling of random fields. (English) Zbl 1246.62194
Summary: This paper introduces a nonparametric algorithm for bootstrapping a stationary random field and proves certain consistency properties of the algorithm for the case of mixing random fields. The motivation for this paper comes from relating a heuristic texture synthesis algorithm popular in computer vision to general nonparametric bootstrapping of stationary random fields. We give a formal resampling scheme for the heuristic texture algorithm and prove that it produces a consistent estimate of the joint distribution of pixels in a window of certain size under mixing and regularity conditions on the random field. The joint distribution of pixels is the quantity of interest here because theories of human perception of texture suggest that two textures with the same joint distribution of pixel values in a suitably chosen window will appear similar to a human. Thus we provide theoretical justification for an algorithm that has already been very successful in practice, and suggest an explanation for its perceptually good results.

62M40 Random fields; image analysis
62G09 Nonparametric statistical resampling methods
65C60 Computational problems in statistics (MSC2010)
91E30 Psychophysics and psychophysiology; perception
Full Text: DOI Euclid arXiv
[1] Abend, K., Harley, T. J. and Kanal, L. N. (1965). Classification of binary random patterns. IEEE Trans. Inform. Theory IT–11 538–544. · Zbl 0129.11801 · doi:10.1109/TIT.1965.1053827
[2] Besag, J. E. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Roy. Statist. Soc. Ser. B 36 192–236. JSTOR: · Zbl 0327.60067 · links.jstor.org
[3] Cressie, N. and Davidson, J. L. (1998). Image analysis with partially ordered Markov models. Comput. Statist. Data Anal. 29 1–26. · Zbl 1042.62611 · doi:10.1016/S0167-9473(98)00052-8
[4] Cross, G. C. and Jain, A. K. (1983). Markov random field texture models. IEEE Trans. Pattern Analysis Machine Intelligence 5 25–39.
[5] De Bonet, J. S. (1997). Multiresolution sampling procedure for analysis and synthesis of texture images. In Proc. 24th Annual Conference on Computer Graphics and Interactive Techniques 361–368. ACM Press, New York.
[6] De Valois, R. L., Albrecht, D. G. and Thorell, L. (1982). Spatial-frequency selectivity of cells in macaque visual cortex. Vision Research 22 545–559.
[7] Doukhan, P. (1994). Mixing : Properties and Examples . Lecture Notes in Statist. 85 . Springer, New York. · Zbl 0801.60027
[8] Efros, A. A. and Freeman, W. T. (2001). Image quilting for texture synthesis and transfer. In Proc. 28th Annual Conference on Computer Graphics and Interactive Techniques 341–346. ACM Press, New York.
[9] Efros, A. A. and Leung, T. (1999). Texture synthesis by non-parametric sampling. In Proc. IEEE International Conference on Computer Vision 2 1033–1038. IEEE Computer Soc., Washington.
[10] Heeger, D. J. and Bergen, J. R. (1995). Pyramid-based texture analysis/synthesis. In Proc. 22nd Annual Conference on Computer Graphics and Interactive Techniques 229–238. ACM Press, New York.
[11] Hubel, D. H. and Wiesel, T. N. (1965). Binocular interaction in striate cortex of kittens reared with artificial squint. J. Neurophysiology 28 1041–1059.
[12] Julesz, B. (1962). Visual pattern discrimination. IRE Trans. Information Theory 8 84–92.
[13] Julesz, B. (1981). Textons, the elements of texture perception, and their interactions. Nature 290 91–97.
[14] Julesz, B., Gilbert, E. N., Shepp, L. A. and Frish, H. L. (1973). Inability of humans to discriminate between visual textures that agree in second-order statistics—revisited. Perception 2 391–405.
[15] K√ľnsch, H. R. (1989). The jackknife and the bootstrap for general stationary observations. Ann. Statist. 17 1217–1241. · Zbl 0684.62035 · doi:10.1214/aos/1176347265
[16] Levina, E. and Bickel, P. J. (2001). The Earth Mover’s distance is the Mallows distance: Some insights from statistics. In Proc. IEEE International Conference on Computer Vision 2 251–256. IEEE Computer Soc., Washington.
[17] Liang, L., Liu, C., Xu, Y., Guo, B. and Shum, H.-Y. (2001). Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001-40, Microsoft Research.
[18] Liu, R. Y. and Singh, K. (1992). Moving blocks jackknife and bootstrap capture weak dependence. In Exploring the Limits of Bootstrap (R. LePage and L. Billard, eds.) 225–248. Wiley, New York. · Zbl 0838.62036
[19] Malik, J. and Perona, P. (1990). Preattentive texture discrimination with early vision mechanism. J. Optical Society America A 7 923–932.
[20] Paparoditis, E. and Politis, D. (2002). The local bootstrap for Markov processes. J. Statist. Plann. Inference 108 301–328. · Zbl 1016.62041 · doi:10.1016/S0378-3758(02)00315-4
[21] Politis, D. N. and Romano, J. P. (1993). Nonparametric resampling for homogeneous strong mixing random fields. J. Multivariate Anal. 47 301–328. · Zbl 0795.62087 · doi:10.1006/jmva.1993.1085
[22] Popat, K. and Picard, R. (1993). Novel cluster-based probability model for texture synthesis, classification, and compression. In Proc. SPIE Visual Communications and Image Processing 2094 756–768. SPIE, Bellingham, WA.
[23] Portilla, J. and Simoncelli, E. P. (2000). A parametric texture model based on joint statistics of complex wavelet coefficients. Internat. J. Computer Vision 40 49–70. · Zbl 1012.68698 · doi:10.1023/A:1026553619983
[24] Rajarshi, M. (1990). Bootstrap in \mboxMarkov sequences based on estimates of transition density. Ann. Inst. Math. Statist. 42 253–268. · Zbl 0714.62036 · doi:10.1007/BF00050835
[25] Simoncelli, E. and Portilla, J. (1998). Texture characterization via joint statistics of wavelet coefficient magnitudes. In Proc. Fifth IEEE International Conference on Image Processing 1 62–66. IEEE Computer Soc., Washington.
[26] Wei, L.-Y. and Levoy, M. (2000). Fast texture synthesis using tree-structured vector quantization. In Proc. 27th Annual Conference on Computer Graphics and Interactive Techniques 479–488. ACM Press, New York.
[27] Wu, Y. N., Zhu, S. C. and Liu, X. (2000). Equivalence of Julesz ensembles and FRAME models. Internat. J. Computer Vision 38 247–265. · Zbl 1012.68692 · doi:10.1023/A:1008199424771
[28] Zhu, S. C., Wu, Y. N. and Mumford, D. (1998). Filters, random fields and maximum entropy (FRAME)—towards a unified theory for texture modeling. Internat. J. Computer Vision 27 107–126.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.