PointCNN swMATH ID: 32557 Software Authors: Li, Yangyan; Bu, Rui; Sun, Mingchao; Wu, Wei; Di, Xinhan; Chen, Baoquan Description: PointCNN: Convolution On X-Transformed Points. We present a simple and general framework for feature learning from point clouds. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids (e.g. images). However, point clouds are irregular and unordered, thus directly convolving kernels against features associated with the points, will result in desertion of shape information and variance to point ordering. To address these problems, we propose to learn an X-transformation from the input points, to simultaneously promote two causes. The first is the weighting of the input features associated with the points, and the second is the permutation of the points into a latent and potentially canonical order. Element-wise product and sum operations of the typical convolution operator are subsequently applied on the X-transformed features. The proposed method is a generalization of typical CNNs to feature learning from point clouds, thus we call it PointCNN. Experiments show that PointCNN achieves on par or better performance than state-of-the-art methods on multiple challenging benchmark datasets and tasks. Homepage: https://arxiv.org/abs/1801.07791 Source Code: https://github.com/yangyanli/PointCNN Keywords: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR) Related Software: PointNet; VoxNet; VoxelNet; OctNet; TensorFlow; t-SNE; MeshCNN; FoldingNet; Point2Sequence; Adam; PointConv; PCPNet; KPConv; SCAPE; 3D2SeqViews; PFCNN; SPLATNet; U-Net; ScanNet; GitHub Cited in: 13 Documents all top 5 Cited by 58 Authors 2 Han, Zhizhong 2 Liu, Xinhai 2 Liu, Yu-Shen 2 Wang, Wenping 1 Anastasiou, Charitos 1 Angeli, Panagiota 1 Arcucci, Rossella 1 Cao, Yan-Pei 1 Chen, Mingjia 1 Cheng, Sibo 1 Cui, Zhiming 1 Dong, Bin 1 Fan, Bo 1 Gu, Min 1 Guo, Xiaohu 1 Guo, Yike 1 He, Fazhi 1 Hong, Fangzhou 1 Hu, Jianwei 1 Hua, Jing 1 Jin, Pengfei 1 Komarichev, Artem 1 Lai, Rongjie 1 Lai, Tianhao 1 Lee, Sanghuk 1 Li, Peifang 1 Lin, Lin 1 Liu, Jian 1 Liu, Ligang 1 Lopata, A. V. 1 Matar, Omar K. 1 Navab, Nassir 1 Orlova, S. R. 1 Pain, Christopher C. 1 Pan, Tianxiang 1 Pan, Yiling 1 Peng, Yifan 1 Singh, Pradeep 1 Song, Yupeng 1 Tombari, Federico 1 Wald, Johanna 1 Wang, Bin 1 Wang, Changbo 1 Wang, Shiyao 1 Wei, Guangshun 1 Yang, Baorong 1 Yang, Lei 1 Yao, Junfeng 1 Ying, Lexing 1 Zepeda-Núñez, Leonardo 1 Zhang, Lina 1 Zhong, Zichun 1 Zhou, Jun 1 Zhou, Yuanfeng 1 Zhu, Chungang 1 Zhu, Jie 1 Zou, Qianfang 1 Zwicker, Matthias Cited in 5 Serials 8 Computer Aided Geometric Design 2 Journal of Scientific Computing 1 Journal of Computational Physics 1 Automation and Remote Control 1 International Journal of Computer Vision all top 5 Cited in 6 Fields 8 Computer science (68-XX) 7 Numerical analysis (65-XX) 2 Information and communication theory, circuits (94-XX) 1 Approximations and expansions (41-XX) 1 Harmonic analysis on Euclidean spaces (42-XX) 1 Fluid mechanics (76-XX) Citations by Year