MatchNet swMATH ID: 31214 Software Authors: Xufeng Han; Thomas Leung; Yangqing Jia; Rahul Sukthankar; Alexander C. Berg Description: MatchNet: Unifying feature and metric learning for patch-based matching. Motivated by recent successes on learning feature representations and on learning feature comparison functions, we propose a unified approach to combining both for training a patch matching system. Our system, dubbed Match-Net, consists of a deep convolutional network that extracts features from patches and a network of three fully connected layers that computes a similarity between the extracted features. To ensure experimental repeatability, we train MatchNet on standard datasets and employ an input sampler to augment the training set with synthetic exemplar pairs that reduce overfitting. Once trained, we achieve better computational efficiency during matching by disassembling MatchNet and separately applying the feature computation and similarity networks in two sequential stages. We perform a comprehensive set of experiments on standard datasets to carefully study the contributions of each aspect of MatchNet, with direct comparisons to established methods. Our results confirm that our unified approach improves accuracy over previous state-of-the-art results on patch matching datasets, while reducing the storage requirement for descriptors. We make pre-trained MatchNet publicly available. Homepage: https://ieeexplore.ieee.org/document/7298948 Source Code: https://github.com/hanxf/matchnet Related Software: HPatches; TILDE; SuperPoint; LF-Net; Key.Net; L2-Net; FlowNet; BRISK; SURF; SIFT; PCA-SIFT; KITTI; ImageNet; SBERT; GLUE; SQuAD; GloVe; SOSNet; Theia; R2D2 Cited in: 5 Publications all top 5 Cited by 18 Authors 1 Bursuc, Andrei 1 Chum, Ondřej 1 Fan, Aoxiang 1 Ha, Namkoo 1 Jang, Hyunsung 1 Jégou, Hervé 1 Jiang, Junjun 1 Jiang, Xingyu 1 Kim, Youngjung 1 LeCun, Yann 1 Ma, Jiayi 1 Mukundan, Arun 1 Oh, Changjae 1 Sohn, Kwanghoon 1 Song, Taeyong 1 Tolias, Giorgos 1 Yan, Junchi 1 Žbontar, Jure Cited in 3 Serials 3 International Journal of Computer Vision 1 Machine Learning 1 Journal of Machine Learning Research (JMLR) Cited in 1 Field 5 Computer science (68-XX) Citations by Year