SPLATNet swMATH ID: 36664 Software Authors: Su, Hang; Jampani, Varun; Sun, Deqing; Maji, Subhransu; Kalogerakis, Evangelos; Yang, Ming-Hsuan; Kautz, Jan Description: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. We present a network architecture for processing point clouds that directly operates on a collection of points represented as a sparse set of samples in a high-dimensional lattice. Naively applying convolutions on this lattice scales poorly, both in terms of memory and computational cost, as the size of the lattice increases. Instead, our network uses sparse bilateral convolutional layers as building blocks. These layers maintain efficiency by using indexing structures to apply convolutions only on occupied parts of the lattice, and allow flexible specifications of the lattice structure enabling hierarchical and spatially-aware feature learning, as well as joint 2D-3D reasoning. Both point-based and image-based representations can be easily incorporated in a network with such layers and the resulting model can be trained in an end-to-end manner. We present results on 3D segmentation tasks where our approach outperforms existing state-of-the-art techniques. Homepage: https://suhangpro.github.io/splatnet/ Source Code: https://github.com/NVlabs/splatnet Dependencies: Python Related Software: PointNet; VoxNet; OctNet; ImageNet; PointConv; KITTI; Mapillary Vistas; DeepLab; SYNTHIA Dataset; ScanComplete; FoldingNet; VoxelNet; PointCNN; PointeNet; PointPillars; PointRCNN; KPConv; ViT; AlexNet; Mask R-CNN Cited in: 7 Documents all top 5 Cited by 27 Authors 1 Alliez, Pierre 1 Barnes, Nick 1 Behnke, Sven 1 Chen, Honghua 1 Chow, Alix L. H. 1 Gould, Stephen 1 Gu, Lipeng 1 Lafarge, Florent 1 Lin, Lin 1 Long, Chengjiang 1 Lopata, A. V. 1 Nan, Liangliang 1 Orlova, S. R. 1 Peng, Yifan 1 Quenzel, Jan 1 Ramasinghe, Sameera 1 Rosu, Radu Alexandru 1 Wei, Mingqiang 1 Xiao, Chunxia 1 Yan, Qingan 1 Yan, Xuefeng 1 Ying, Lexing 1 Yu, Mulin 1 Zepeda-Núñez, Leonardo 1 Zhang, Wenxiao 1 Zhao, Tong 1 Zhu, Dingkun Cited in 4 Serials 3 Computer Aided Geometric Design 2 International Journal of Computer Vision 1 Journal of Computational Physics 1 Automation and Remote Control Cited in 5 Fields 4 Numerical analysis (65-XX) 4 Computer science (68-XX) 1 Approximations and expansions (41-XX) 1 Harmonic analysis on Euclidean spaces (42-XX) 1 Information and communication theory, circuits (94-XX) Citations by Year