×

Multiview clustering via exclusive non-negative subspace learning and constraint propagation. (English) Zbl 1484.62087

Summary: Multiview clustering partitions a set of data into groups by exploring complementary information of multiple views. The mainstream tries to project the multiview data into a commonly shared subspace and further discover the true data structure. Ideally, clusters in the subspace should share less semantics with each other so that distinct groups can be obtained while this exclusivity is not guaranteed in previous works. To this end, this paper proposes a non-negative matrix factorization based subspace learning method for exclusive multiview clustering, where the double-orthogonal constraints are imposed for the cluster exclusivity. Moreover, to boost the clustering performance, the proposed method also exploits the available labeled data and is extended into a semi-supervised manner. Particularly, by incorporating the propagated semi-supervised manifold regularizations, the limited supervised information is enriched and encoded in our method to guide the learning process. The formulated optimization problem can be solved by the derived iterative updating rules. Experimental results on seven public datasets demonstrate its promising performance against other state-of-the-art approaches.

MSC:

62H30 Classification and discrimination; cluster analysis (statistical aspects)
68T05 Learning and adaptive systems in artificial intelligence
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Shaokai Wang, Eric Ke Wang, Xutao Li, Yunming Ye, Raymond YK Lau, Xiaolin Du, Multi-view learning via multiple graph regularized generative model. Knowledge-Based Systems, 121 (2017) 153-162.
[2] Li, Jinxing; Zhang, Bob; Guangming, Lu; Zhang, David, Generative multi-view and multi-feature learning for classification, Information Fusion, 45, 215-226 (2019)
[3] Jinxing Li, Guangming Lu, Bob Zhang, Jane You, David Zhang, Shared linear encoder-based multikernel gaussian process latent variable model for visual classification, IEEE Transactions on Cybernetics (2019).
[4] Tzortzis, Grigorios F.; Likas, Aristidis C., Multiple view clustering using a weighted combination of exemplar-based mixture models, IEEE Transactions on Neural Networks, 21, 12, 1925-1938 (2010)
[5] Nie, Feiping; Ding, Chris; Luo, Dijun; Huang, Heng, Improved minmax cut graph clustering with nonnegative relaxation, (Joint European Conference on Machine Learning and Knowledge Discovery in Databases (2010), Springer), 451-466
[6] Von Luxburg, Ulrike, A tutorial on spectral clustering, Statistics and Computing, 17, 4, 395-416 (2007)
[7] Abhishek Kumar, Hal Daumé, A co-training approach for multi-view spectral clustering, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 393-400.
[8] Feiping Nie, Guohao Cai, Xuelong Li, Multi-view clustering and semi-supervised classification with adaptive neighbours, in: Thirty-First AAAI Conference on Artificial Intelligence, 2017. · Zbl 1409.94460
[9] Nie, Feiping; Cai, Guohao; Li, Jing; Li, Xuelong, Auto-weighted multi-view learning for image clustering and semi-supervised classification, IEEE Transactions on Image Processing, 27, 3, 1501-1511 (2017) · Zbl 1409.94460
[10] Feiping Nie, Jing Li, Xuelong Li, et al., Self-weighted multiview clustering with multiple graphs, in: IJCAI, 2017, pp. 2564-2570.
[11] Chaudhuri, Kamalika; Kakade, Sham M.; Livescu, Karen; Sridharan, Karthik, Multi-view clustering via canonical correlation analysis, (Proceedings of the 26th Annual International Conference on Machine Learning (2009), ACM), 129-136
[12] Sheng Wang, Jianfeng Lu, Xingjian Gu, Benjamin A. Weyori, Jing-yu Yang, Unsupervised discriminant canonical correlation analysis based on spectral clustering, Neurocomputing, 171 (2016) 425-433.
[13] Liu, Weifeng; Yang, Xinghao; Tao, Dapeng; Cheng, Jun; Tang, Yuanyan, Multiview dimension reduction via hessian multiset canonical correlations, Information Fusion, 41, 119-128 (2018)
[14] Shotaro Akaho, A kernel method for canonical correlation analysis, arXiv preprint cs/0609071, 2006. · Zbl 1047.68094
[15] Hao Wang, Yan Yang, Tianrui Li, Multi-view clustering via concept factorization with local manifold regularization, in: 2016 IEEE 16th International Conference on Data Mining (ICDM), IEEE, 2016, pp. 1245-1250.
[16] Zhan, Kun; Shi, Jinhui; Wang, Jing; Wang, Haibo; Xie, Yuange, Adaptive structure concept factorization for multiview clustering, Neural Computation, 30, 4, 1080-1103 (2018) · Zbl 1472.68168
[17] Elhamifar, Ehsan; Vidal, Rene, Sparse subspace clustering: algorithm, theory, and applications, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 11, 2765-2781 (2013)
[18] Gao, Hongchang; Nie, Feiping; Li, Xuelong; Huang, Heng, Multi-view subspace clustering, (Proceedings of the IEEE International Conference on Computer Vision (2015)), 4238-4246
[19] Wang, Yang; Zhang, Wenjie; Lin, Wu; Lin, Xuemin; Fang, Meng; Pan, Shirui, Iterative views agreement: an iterative low-rank based structured optimization method to multi-view spectral clustering, (Twenty-Fifth International Joint Conference on Artificial Intelligence (2016)), 2153-2159
[20] Zhang, Changqing; Huazhu, Fu.; Qinghua, Hu; Cao, Xiaochun; Xie, Yuan; Tao, Dacheng; Dong, Xu, Generalized latent multi-view subspace clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 1, 86-99 (2018)
[21] Wang, Yang; Lin, Wu; Lin, Xuemin; Gao, Junbin, Multiview spectral clustering via structured low-rank matrix factorization, IEEE Transactions on Neural Networks and Learning Systems, 29, 10, 4833-4843 (2018)
[22] Wang, Yang; Lin, Wu, Beyond low-rank representations: orthogonal clustering basis reconstruction with optimized graph structure for multi-view spectral clustering, Neural Networks, 103, 1-8 (2018) · Zbl 1434.68469
[23] Yin, Ming; Gao, Junbin; Xie, Shengli; Guo, Yi, Multiview subspace clustering via tensorial t-product representation, IEEE Transactions on Neural Networks and Learning Systems, 30, 3, 851-864 (2018)
[24] Cheng, Miaomiao; Jing, Liping; Ng, Michael K., Tensor-based low-dimensional representation learning for multi-view clustering, IEEE Transactions on Image Processing, 28, 5, 2399-2414 (2018)
[25] Ding, Chris; Li, Tao; Peng, Wei; Park, Haesun, Orthogonal nonnegative matrix t-factorizations for clustering, (Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2006), ACM), 126-135
[26] Liu, Jialu; Wang, Chi; Gao, Jing; Han, Jiawei, Multi-view clustering via joint nonnegative matrix factorization, (Proceedings of the 2013 SIAM International Conference on Data Mining (2013), SIAM), 252-260
[27] Weihua, Ou; Long, Fei; Tan, Yi; Shujian, Yu; Wang, Pengpeng, Co-regularized multiview nonnegative matrix factorization with correlation constraint for representation learning, Multimedia Tools and Applications, 77, 10, 12955-12978 (2018)
[28] Guan, Ziyu; Zhang, Lijun; Peng, Jinye; Fan, Jianping, Multi-view concept learning for data representation, IEEE Transactions on Knowledge and Data Engineering, 27, 11, 3016-3028 (2015)
[29] Xianchao Zhang, Zhongxiu Wang, Linlin Zong, Hong Yu, Multi-view clustering via graph regularized symmetric nonnegative matrix factorization, in: 2016 IEEE International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), IEEE, 2016, pp. 109-114.
[30] Zhang, Xinyu; Gao, Hongbo; Li, Guopeng; Zhao, Jianhui; Huo, Jianghao; Yin, Jialun; Liu, Yuchao; Zheng, Li, Multi-view clustering based on graph-regularized nonnegative matrix factorization for object recognition, Information Sciences, 432, 463-478 (2018) · Zbl 1436.68323
[31] Nishant Rai, Sumit Negi, Santanu Chaudhury, Om Deshmukh, Partial multi-view clustering using graph regularized nmf, in: 2016 23rd International Conference on Pattern Recognition (ICPR), IEEE, 2016, pp. 2192-2197.
[32] Luo, Peng; Peng, Jinye; Guan, Ziyu; Fan, Jianping, Dual regularized multi-view non-negative matrix factorization for clustering, Neurocomputing, 294, 1-11 (2018)
[33] Wang, Jing; Tian, Feng; Hongchuan, Yu; Liu, Chang Hong; Zhan, Kun; Wang, Xiao, Diverse non-negative matrix factorization for multiview data representation, IEEE Transactions on Cybernetics, 48, 9, 2620-2632 (2018)
[34] Zhong Zhang, Zhili Qin, Peiyan Li, Qinli Yang, Junming Shao, Multi-view discriminative learning via joint non-negative matrix factorization, in: International Conference on Database Systems for Advanced Applications, Springer, 2018, pp. 542-557.
[35] Handong Zhao, Zhengming Ding, Yun Fu, Multi-view clustering via deep matrix factorization, in: Thirty-First AAAI Conference on Artificial Intelligence, 2017.
[36] Jing Liu, Yu.; Jiang, Zechao Li; Zhou, Zhi-Hua; Hanqing, Lu., Partially shared latent factor learning with multiview data, IEEE Transactions on Neural Networks and Learning Systems, 26, 6, 1233-1246 (2015)
[37] Jing Wang, Xiao Wang, Feng Tian, Chang Hong Liu, Hongchuan Yu, Yanbei Liu, Adaptive multi-view semi-supervised nonnegative matrix factorization, in: International Conference on Neural Information Processing, Springer, 2016, pp. 435-444.
[38] Cai, Hao; Liu, Bo; Xiao, Yanshan; Lin, LuYue, Semi-supervised multi-view clustering based on constrained nonnegative matrix factorization, Knowledge-Based Systems (2019)
[39] Wang, Yang; Zhang, Wenjie; Lin, Wu; Lin, Xuemin; Zhao, Xiang, Unsupervised metric fusion over multiview data by graph random walk-based cross-view diffusion, IEEE Transactions on Neural Networks and Learning Systems, 28, 1, 57-70 (2015)
[40] Wang, Di; Gao, Xinbo; Wang, Xiumei, Semi-supervised nonnegative matrix factorization via constraint propagation, IEEE Transactions on Cybernetics, 46, 1, 233-244 (2016)
[41] Dengyong Zhou, Olivier Bousquet, Thomas N. Lal, Jason Weston, Bernhard Schölkopf, Learning with local and global consistency, in: Advances in Neural Information Processing Systems, 2004, pp. 321-328.
[42] Zhiwu Lu, Horace HS Ip, Constrained spectral clustering via exhaustive and efficient constraint propagation, in: European Conference on Computer Vision, Springer, 2010, pp. 1-14.
[43] Daniel D. Lee, H. Sebastian Seung, Learning the parts of objects by non-negative matrix factorization. Nature, 401 (6755) (1999) 788. · Zbl 1369.68285
[44] Razaviyayn, Meisam; Hong, Mingyi; Luo, Zhi-Quan, A unified convergence analysis of block successive minimization methods for nonsmooth optimization, SIAM Journal on Optimization, 23, 2, 1126-1153 (2013) · Zbl 1273.90123
[45] Ding, C. H.Q.; Li, T.; Jordan, M. I., Convex and semi-nonnegative matrix factorizations, IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 1, 45-55 (2010)
[46] Seunghoon Hong, Jonghyun Choi, Jan Feyereisl, Bohyung Han, Larry S. Davis, Joint image clustering and labeling by matrix factorization, IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 (7) (2016) 1411-1424.
[47] Zhan, Kun; Nie, Feiping; Wang, Jing; Yang, Yi, Multiview consensus graph clustering, IEEE Transactions on Image Processing, 28, 3, 1261-1270 (2019)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.