Content-based image collection summarization and comparison using self-organizing maps. (English) Zbl 1118.68138

Deng, Da

Pattern Recognition 40, No. 2, 718-727 (2007).

Summary: Progresses made on content-based image retrieval have reactivated the research on image analysis and a number of similarity-based methods have been established to assess the similarity between images. In this paper, the content-based approach is extended towards the problem of image collection summarization and comparison. For these purposes we propose to carry out clustering analysis on visual features using self-organizing maps, and then evaluate their similarity using a few dissimilarity measures implemented on the feature maps. The effectiveness of these dissimilarity measures is then examined with an empirical study.

MSC:

68T10	Pattern recognition, speech recognition
68U10	Computing methodologies for image processing

Keywords:

content-based image retrieval; self-organizing maps; dissimilarity

Software:

VisualSEEk; SOM_PAK; EMD; SOMLib

References:

[1]	Carson, C.; Thomas, M.; Belongie, S., Blobworld: a system for region-based image indexing and retrieval, (Proceedings of the International Conference on Visual Information Systems (1999)), 509-516
[2]	Smith, J.; Chang, S., Visualseek: a fully automated content-based image query system, (Proceedings of ACM Multimedia, vol. 96 (1996)), 87-98
[3]	Smeulders, A.; Worring, M.; Santini, S.; Gupta, A.; R., J., Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell., 22, 12, 1349-1380 (2000)
[6]	Brunelli, R.; Mich, O., Histograms analysis for image retrieval, Pattern Recognition, 34, 1625-1637 (2001) · Zbl 0984.68708
[7]	Rubner, Y.; Tomasi, C.; Guibas, L., A metric for distributions with applications to image databases, (Proceedings of IEEE ICCV (1998)), 59-66
[8]	Mathiassen, J. R.; Skavhaug, A.; Bø, K., Texture similarity measure using Kullback-Leibler divergence between gamma distributions, (ECCV ’02: Proceedings of the Seventh European Conference on Computer Vision-Part III. ECCV ’02: Proceedings of the Seventh European Conference on Computer Vision-Part III, Springer, London, UK (2002)), 133-147 · Zbl 1039.68686
[9]	Kohonen, T., Self-organizing Maps (1997), Springer: Springer Berlin · Zbl 0866.68085
[10]	Rauber, A.; Merkl, D., The digital library system, (Proceedings of European Conference on Digital Libraries (1999)), 323-342
[11]	Laaksonen, J.; Koskela, M.; Oja, E., Content-based image retrieval using self-organizing maps, (Visual Information and Information Systems (1999)), 541-548
[12]	Haykin, S., Neural Networks: A Comprehensive Foundation (1999), Prentice-Hall: Prentice-Hall Englewood Cliffs, NJ · Zbl 0934.68076
[13]	Ritter, H., Asymptotic level density for a class of vector quantization processes, IEEE Trans. Neural Networks, 2, 173-175 (1991)
[14]	Yin, H.; Allison, N., Self-organizing mixture networks for probability density estimation, IEEE Trans. Neural Networks, 12, 2, 405-411 (2001)
[15]	Sammon, W., A nonlinear mapping for data analysis, IEEE Trans. Comput., 5, 401-409 (1969)
[16]	Kaski, S.; Lagus, K., Comparing self-organizing maps, (Vorbruggen, J.; Sendhoff, B., Proceedings of ICANN96 International Conference on Artificial Neural Networks, Lecture Notes in Computer Science, vol. 1112 (1996), Springer: Springer Berlin), 809-814
[17]	Honkela, T., Comparisons of self-organized word category maps, (Proceedings of WSOM97, Workshop on Self-Organizing Maps, Helsinki University of Technology, Neural Networks Research Centre, Espoo, Finland (1997)), 298-303
[18]	Fritzke, B., A growing neural gas network learns topologies, (Proceedings of NIPS (1994)), 625-632
[19]	Eiter, T.; Mannila, H., Distance measures for point sets and their computation, Acta Informica, 34, 109-133 (1997) · Zbl 0865.51011
[20]	Manjunath, B. S.; Ma, W., Texture features for browsing and retrieval of image data, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI—Special issue on Digital Libraries), 18, 8, 837-842 (1996), URL: \( \langle\) http://vision.ece.ucsb.edu/publications/96PAMITrans.pdf \(\rangle \)
[22]	Puzicha, J.; Rubner, Y.; Tomasi, C.; Buhmann, J., Empirical evaluation of dissimilarity measures for color and texture, (Proceedings of the IEEE International Conference on Computer Vision (ICCV-1999) (1999)), 1165-1173
[23]	Deng, D.; Kasabov, N., On-line pattern analysis by evolving self-organizing maps, Neurocomputing, 51, 87-103 (2003)
[24]	Tino, P.; Nabney, I., Hierarchical GTM: constructing localized nonlinear projection manifolds in a principled way, IEEE Trans. Pattern Anal. Mach. Intell., 24, 5, 639-656 (2002)