3DMatch swMATH ID: 32561 Software Authors: Andy Zeng, Shuran Song, Matthias Nießner, Matthew Fisher, Jianxiong Xiao, Thomas Funkhouser Description: 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. Matching local geometric features on real-world depth images is a challenging task due to the noisy, low-resolution, and incomplete nature of 3D scan data. These difficulties limit the performance of current state-of-art methods, which are typically based on histograms over geometric properties. In this paper, we present 3DMatch, a data-driven model that learns a local volumetric patch descriptor for establishing correspondences between partial 3D data. To amass training data for our model, we propose an unsupervised feature learning method that leverages the millions of correspondence labels found in existing RGB-D reconstructions. Experiments show that our descriptor is not only able to match local geometry in new scenes for reconstruction, but also generalize to different tasks and spatial scales (e.g. instance-level object model alignment for the Amazon Picking Challenge, and mesh surface correspondence). Results show that 3DMatch consistently outperforms other state-of-the-art approaches by a significant margin. Homepage: http://3dmatch.cs.princeton.edu Related Software: PointNet; PPFNet; SIFT; Go-ICP; YFCC100M; SOSNet; L2-Net; Theia; R2D2; BinGAN; MAGSAC++; USAC; D2-Net; GMS; ContextDesc; ASLFeat; SuperGlue; FusionGAN; Quicksilver; ApolloScape Cited in: 6 Documents all top 5 Cited by 23 Authors 1 Bennamoun, Mohammed 1 Bernardes Vieira, Marcelo 1 Chen, Mingjia 1 de Almeida, Liliane Rodrigues 1 Derhami, Vali 1 Dyke, Roberto M. 1 Fan, Aoxiang 1 Giraldi, Gilson Antonio 1 Jiang, Junjun 1 Jiang, Xingyu 1 Lai, Yu-Kun 1 Liu, Ligang 1 Ma, Jiayi 1 Miranda, Gastão Florêncio jun. 1 Rezaei, Masoumeh 1 Rezaeian, Mehdi 1 Rosin, Paul L. 1 Samir, Chafik 1 Sohel, Ferdous A. 1 Tam, Gary K. L. 1 Wang, Changbo 1 Yan, Junchi 1 Zou, Qianfang Cited in 4 Serials 3 Computer Aided Geometric Design 1 Applied Mathematics and Computation 1 Journal of Mathematical Imaging and Vision 1 International Journal of Computer Vision Cited in 4 Fields 6 Computer science (68-XX) 2 Numerical analysis (65-XX) 1 Manifolds and cell complexes (57-XX) 1 Information and communication theory, circuits (94-XX) Citations by Year