×

SVM-based active feedback in image retrieval using clustering and unlabeled data. (English) Zbl 1151.68397

Summary: In content-based image retrieval, relevance feedback is studied extensively to narrow the gap between low-level image feature and high-level semantic concept. However, most methods are challenged by small sample size problem since users are usually not so patient to label a large number of training instances in the relevance feedback round. In this paper, this problem is solved by two strategies: (1) designing a new active selection criterion to select images for user’s feedback. It takes both the informative and the representative measures into consideration, thus the diversities between these images are increased while their informative powers are kept. With this new criterion, more information gain can be obtained from the feedback images; and (2) incorporating unlabeled images within the co-training framework. Unlabeled data partially alleviates the training data scarcity problem, thus improves the efficiency of support vector machine active learning. Systematic experimental results verify the superiority of our method over existing active learning methods.

MSC:

68P20 Information storage and retrieval of data
68T10 Pattern recognition, speech recognition
68U10 Computing methodologies for image processing

Software:

PicHunter
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Zhou, X. S.; Huang, T. S., Relevance feedback in image retrieval: a comprehensive review, Multimedia Systems, 8, 6, 536-544 (2003)
[2] Smeulders, A.; Worring, M.; Santini, S.; Gupta, A.; Jain, R., Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell., 22, 12, 1349-1380 (2000)
[3] Rui, Y.; Huang, T. S.; Ortega, M.; Mehrotra, S., Relevance feedback: a power tool for interactive content-based image retrieval, IEEE Trans. Circuits Video Technol., 8, 5, 644-655 (1998)
[4] Giacinto, G.; Roli, F., Bayesian relevance feedback for content-based image retrieval, Pattern Recognition, 37, 7, 1499-1508 (2004) · Zbl 1070.68585
[5] Y. Wu, A. Zhang, A feature re-weighting approach for relevance feedback in image retrieval, in: Proceedings of the International Conference on Image Processing, 2002, pp. 581-584.; Y. Wu, A. Zhang, A feature re-weighting approach for relevance feedback in image retrieval, in: Proceedings of the International Conference on Image Processing, 2002, pp. 581-584.
[6] C. Meilhac, C. Nastar, Relevance feedback and category search in image databases, in: Proceedings of the International Conference on Multimedia Components and Systems, 1999, pp. 512-517.; C. Meilhac, C. Nastar, Relevance feedback and category search in image databases, in: Proceedings of the International Conference on Multimedia Components and Systems, 1999, pp. 512-517.
[7] Tao, D.; Tang, X.; Li, X.; Rui, Y., Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm, IEEE Trans. Multimedia, 8, 4, 716-726 (2006)
[8] Y. Wu, Q. Tian, T.S. Huang, Discriminant-EM algorithm with application to image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2000, pp. 222-227.; Y. Wu, Q. Tian, T.S. Huang, Discriminant-EM algorithm with application to image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2000, pp. 222-227.
[9] S. Tong, E. Chang, Support vector machine active learning for image retrieval, in: Proceedings of the ACM Multimedia, 2001, pp. 107-118.; S. Tong, E. Chang, Support vector machine active learning for image retrieval, in: Proceedings of the ACM Multimedia, 2001, pp. 107-118.
[10] J. He, M. Li, H.-J. Zhang, H. Tong, C. Zhang, Mean version space: a new active learning method for content-based image retrieval, in: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR), 2004, pp. 15-22.; J. He, M. Li, H.-J. Zhang, H. Tong, C. Zhang, Mean version space: a new active learning method for content-based image retrieval, in: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR), 2004, pp. 15-22.
[11] L. Wang, K.L. Chan, Z. Zhang, Bootstrapping SVM active learning by incorporating unlabelled images for image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2003, pp. 629-634.; L. Wang, K.L. Chan, Z. Zhang, Bootstrapping SVM active learning by incorporating unlabelled images for image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2003, pp. 629-634.
[12] C. Zhang, X. Chen, M. Chen, S.-C. Chen, M.-L. Shyu, A multiple instance learning approach for content based image retrieval using one-class support vector machine, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2005, pp. 1142-1145.; C. Zhang, X. Chen, M. Chen, S.-C. Chen, M.-L. Shyu, A multiple instance learning approach for content based image retrieval using one-class support vector machine, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2005, pp. 1142-1145.
[13] Kim, H.-C.; Pang, S.; Je, H.-M.; Kim, D.; Bang, S. Y., Constructing support vector machine ensemble, Pattern Recognition, 36, 12, 2757-2767 (2003) · Zbl 1059.68091
[14] D. Tao, X. Tang, Random sampling based SVM for relevance feedback image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2004, pp. 647-652.; D. Tao, X. Tang, Random sampling based SVM for relevance feedback image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2004, pp. 647-652.
[15] Cox, I. J.; Miller, M. L.; Minka, T. P.; Papathomas, T. V.; Yianilos, P. N., The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments, IEEE Trans. Image Process., 9, 1, 20-37 (2000)
[16] K. Brinker, Incorporating diversity in active learning with support vector machines, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 59-66.; K. Brinker, Incorporating diversity in active learning with support vector machines, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 59-66.
[17] X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 912-919.; X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 912-919.
[18] Zhou, Z. H., Enhancing relevance feedback in image retrieval using unlabeled data, ACM Trans. Inf. Syst., 24, 2, 219-244 (2006)
[19] Shi, J.; Malik, J., Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 22, 8, 888-905 (2000)
[20] Chen, Y.; Wang, J. Z.; Krovetz, R., CLUE: cluter-based retrieval of images by unsupervised learning, IEEE Trans. Image Process., 14, 8, 1187-1201 (2005)
[21] Belkin, M.; Niyogi, P., Semi-supervised learning on Riemannian manifolds, Machine Learn., 56, 1-3, 209-239 (2004) · Zbl 1089.68086
[22] M. Safar, C. Shahabi, X. Sun, Image retrieval by shape: a comparative study, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2000, pp. 141-144.; M. Safar, C. Shahabi, X. Sun, Image retrieval by shape: a comparative study, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2000, pp. 141-144.
[23] Kim, W.-Y.; Kim, Y.-S., A region-based shape descriptor using Zernike moments, Signal Process.: Image Commun., 16, 1, 95-102 (2000)
[24] W.Y. Ma, B.S. Manjunath, A comparison of wavelet transform features for texture image annotation, in: Proceedings of the IEEE International Conference on Image Processing, 1995, pp. 256-259.; W.Y. Ma, B.S. Manjunath, A comparison of wavelet transform features for texture image annotation, in: Proceedings of the IEEE International Conference on Image Processing, 1995, pp. 256-259.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.