×

Fusing attributed and topological global-relations for network embedding. (English) Zbl 1484.68209

Summary: Network embedding aims to learn a vector for each node while preserves inherent properties of the network. Topological structure and node attributes are both critical for understanding the network formulation. This paper focuses on making the topological and attributed properties complement each other. We propose FATNet for integrating the global relations of the topology and attributes into robust representations. Specifically, non-local attribute relations are proposed to capture long-distance dependencies for enriching the topological structure. Meanwhile, we design attributes smoothing filter to preserve the critical attribute values, while interpolating global topology relations via high-order proximity. These relations provide reasonable principles to fuse the structure and attribute for network embedding. Extensive experiments are carried out with five real-world datasets on four downstream tasks, including node classification, link prediction, node clustering and graph visualization. Experiments have shown that the FATNet can achieve superior performance in most cases.

MSC:

68T07 Artificial neural networks and deep learning
68R10 Graph theory (including graph drawing) in computer science
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] N. Barbieri, F. Bonchi, G. Manco, Who to follow and why: link prediction with explanations, in: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2014, pp. 1266-1275.
[2] Belkin, M.; Niyogi, P., Laplacian eigenmaps and spectral techniques for embedding and clustering, Adv. Neural Inf. Process. Syst., 14, 585-591 (2001)
[3] Bengio, Y.; Courville, A.; Vincent, P., Representation learning: a review and new perspectives, IEEE Trans. Pattern Anal. Mach. Intell., 35, 1798-1828 (2013)
[4] Cai, H.; Zheng, V. W.; Chang, K. C.C., A comprehensive survey of graph embedding: problems, techniques, and applications, IEEE Trans. Knowl. Data Eng., 30, 1616-1637 (2018)
[5] Cao, S.; Lu, W.; Xu, Q., Deep neural networks for learning graph representations, (Thirtieth AAAI Conference on Artificial Intelligence (2016))
[6] Cao, S.; Wei, L.; Xu, Q., Grarep: learning graph representations with global structural information, (Acm International on Conference on Information & Knowledge Management (2015))
[7] K. Cheng, J. Li, H. Liu, Unsupervised feature selection in signed social networks, in: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, ACM, pp. 777-786
[8] Cheng, Y.; Zhao, D.; Zhao, D.; Chang, E. Y.; Chang, E. Y., Network representation learning with rich text information, (International Conference on Artificial Intelligence (2015))
[9] Y. Dong, N.V. Chawla, A. Swami, metapath2vec: scalable representation learning for heterogeneous networks, in: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, ACM, pp. 135-144.
[10] H. Gao, H. Huang, Deep attributed network embedding, in: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, International Joint Conferences on Artificial Intelligence Organization, 2018, pp. 3364-3370. 10.24963/ijcai.2018/467.
[11] Gao, H.; Nie, F.; Li, X.; Huang, H., Multi-view subspace clustering, (Proceedings of the IEEE International Conference on Computer Vision (2015)), 4238-4246
[12] Gao, Y.; Gong, M.; Xie, Y.; Zhong, H., Community-oriented attributed network embedding, Knowl. Based Syst., 193, Article 105418 pp. (2020)
[13] A. Grover, J. Leskovec, node2vec: scalable feature learning for networks, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2016, pp. 855-864
[14] M. Guo, R. Zhang, F. Nie, X. Li, Embedding fuzzy k-means with nonnegative spectral clustering via incorporating side information, in: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, 2018, ACM, pp. 1567-1570
[15] He, X.; Niyogi, P., Locality preserving projections, (Proceedings of the 16th International Conference on Neural Information Processing Systems (2003), MIT Press: MIT Press Cambridge, MA, USA), 153-160
[16] K. Henderson, B. Gallagher, T. Eliassi-Rad, H. Tong, S. Basu, L. Akoglu, D. Koutra, C. Faloutsos, L. Li, Rolx: structural role extraction and mining in large graphs, in: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2012, ACM, pp. 1231-1239
[17] Hofmann, T., Unsupervised learning by probabilistic latent semantic analysis, Mach. Learn., 42, 177-196 (2001) · Zbl 0970.68130
[18] X. Huang, J. Li, X. Hu, Label informed attributed network embedding, in: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, 2017, ACM, New York, NY, USA, pp. 731-739. 10.1145/3018661.3018667.
[19] Jian, T.; Meng, Q.; Mei, Q., Pte: predictive text embedding through large-scale heterogeneous text networks, (Acm Sigkdd International Conference on Knowledge Discovery & Data Mining (2015))
[20] Kipf, T. N.; Welling, M., Variational graph auto-encoders, NeurIPS Bayesian Deep Learning Workshop (2016)
[21] Li, D.; Zhang, S.; Sun, X.; Zhou, H.; Li, S.; Li, X., Modeling information diffusion over social networks for temporal dynamic prediction, IEEE Trans. Knowl. Data Eng., 29, 1985-1997 (2017)
[22] J. Li, X. Hu, L. Wu, H. Liu, Robust unsupervised feature selection on networked data, in: Proceedings of the 2016 SIAM International Conference on Data Mining, 2016, SIAM, pp. 387-395
[23] J. Li, L. Wu, O.R. Zaïane, H. Liu, Toward personalized relational learning, in: Proceedings of the 2017 SIAM International Conference on Data Mining, 2017, SIAM, pp. 444-452.
[24] J. Liang, P. Jacobs, S. Parthasarathy, Seano: semi-supervised embedding in attributed networks with outliers, 2018.
[25] L. Liao, X. He, H. Zhang, T.S. Chua, Attributed social network embedding, IEEE Trans. Knowl. Data Eng. PP (2017) 1-1.
[26] Mikolov, T.; Chen, K.; Corrado, G.; Dean, J., Efficient estimation of word representations in vector space, (International Conference on Learning Representations (2013))
[27] S. Nandanwar, M.N. Murty, Structural neighborhood based classification of nodes in a network, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, ACM, 2939782, pp. 1085-1094.
[28] M. Ou, P. Cui, J. Pei, Z. Zhang, W. Zhu, Asymmetric transitivity preserving graph embedding, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, ACM, pp. 1105-1114.
[29] C. young Park, D. Kim, J. Han, H. Yu, Unsupervised attributed multiplex network embedding, in: AAAI, 2020.
[30] C. Peng, W. Xiao, P. Jian, W. Zhu, A survey on network embedding, IEEE Trans. Knowl. Data Eng. PP (2017) 1-1.
[31] B. Perozzi, R. Al-Rfou, S. Skiena, Deepwalk: online learning of social representations, in: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014, ACM, pp. 701-710
[32] J.J. Pfeiffer III, S. Moreno, T. La Fond, J. Neville, B. Gallagher, Attributed graph models: modeling network structure with correlated attributes, in: Proceedings of the 23rd International Conference on World Wide Web, 2014, ACM, pp. 831-842.
[33] Salakhutdinov, R.; Hinton, G., Semantic hashing, Int. J. Approx. Reason., 50, 969-978 (2009)
[34] C. Shi, B. Hu, W.X. Zhao, P.S. Yu, Heterogeneous information network embedding for recommendation, IEEE Trans. Knowl. Data Eng. PP (2017) 1-1.
[35] Shi, C.; Kong, X.; Huang, Y.; Philip, S. Y.; Wu, B., Hetesim: a general framework for relevance measure in heterogeneous networks, IEEE Trans. Knowl. Data Eng., 26, 2479-2492 (2014)
[36] Sun, X.; Song, Z.; Dong, J.; Yu, Y.; Plant, C.; Böhm, C., Network structure and transfer behaviors embedding via deep prediction model, (Proceedings of the AAAI Conference on Artificial Intelligence (2019)), 5041-5048
[37] J. Tang, H. Liu, Unsupervised feature selection for linked social media data, in: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2012, ACM, pp. 904-912
[38] J. Tang, M. Qu, M. Wang, M. Zhang, J. Yan, Q. Mei, Line: large-scale information network embedding, in: Proceedings of the 24th International Conference on World Wide Web, 2015, ACM, pp. 1067-1077
[39] Tenenbaum, J. B.; De Silva, V.; Langford, J. C., A global geometric framework for nonlinear dimensionality reduction, Science, 290, 2319-2323 (2000)
[40] L. Van der Maaten, G. Hinton, L.V.D. Maaten, Visualizing data using t-sne, J. Mach. Learn. Res. 9 (2017) 2579-2605. · Zbl 1225.68219
[41] D. Wang, P. Cui, W. Zhu, Structural deep network embedding, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, ACM, 2939753, pp. 1225-1234.
[42] D. Wang, D. Pedreschi, C. Song, F. Giannotti, A.L. Barabasi, Human mobility, social ties, and link prediction, in: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2011, ACM, pp. 1100-1108.
[43] Xie, Y.; Gong, M.; Qin, A.; Tang, Z.; Fan, X., Tpne: topology preserving network embedding, Inf. Sci., 504, 20-31 (2019) · Zbl 1453.68144
[44] Xie, Y.; Wang, X.; Jiang, D.; Xu, R., High-performance community detection in social networks using a deep transitive autoencoder, Inf. Sci., 493, 75-90 (2019) · Zbl 1451.68235
[45] Yang, C.; Liu, Z.; Zhao, D.; Sun, M.; Chang, E., Network representation learning with rich text information, (Twenty-Fourth International Joint Conference on Artificial Intelligence (2015))
[46] W. Yu, W. Cheng, C. Aggarwal, B. Zong, H. Chen, W. Wang, Self-attentive attributed network embedding through adversarial learning, in: 2019 IEEE International Conference on Data Mining, 2019, IEEE, pp. 758-767. 10.1109/ICDM.2019.00086
[47] Yu, Z.; Zhang, Z.; Chen, H.; Shao, J., Structured subspace embedding on attributed networks, Inf. Sci. (2019)
[48] D. Zhang, J. Yin, X. Zhu, C. Zhang, Collective classification via discriminative matrix factorization on sparsely labeled networks, in: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, 2016, ACM, pp. 1563-1572
[49] Zhang, W.; Du, Y.; Yoshida, T.; Yang, Y., Deeprec: a deep neural network approach to recommendation with item embedding and weighted loss function, Inf. Sci., 470, 121-140 (2019)
[50] Zhang, Z.; Yang, H.; Bu, J.; Zhou, S.; Yu, P.; Zhang, J.; Ester, M.; Wang, C., Anrl: attributed network representation learning via deep neural networks, (Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, International Joint Conferences on Artificial Intelligence Organization (2018)), 3155-3161
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.