swMATH ID: 31214
Software Authors: Xufeng Han; Thomas Leung; Yangqing Jia; Rahul Sukthankar; Alexander C. Berg
Description: MatchNet: Unifying feature and metric learning for patch-based matching. Motivated by recent successes on learning feature representations and on learning feature comparison functions, we propose a unified approach to combining both for training a patch matching system. Our system, dubbed Match-Net, consists of a deep convolutional network that extracts features from patches and a network of three fully connected layers that computes a similarity between the extracted features. To ensure experimental repeatability, we train MatchNet on standard datasets and employ an input sampler to augment the training set with synthetic exemplar pairs that reduce overfitting. Once trained, we achieve better computational efficiency during matching by disassembling MatchNet and separately applying the feature computation and similarity networks in two sequential stages. We perform a comprehensive set of experiments on standard datasets to carefully study the contributions of each aspect of MatchNet, with direct comparisons to established methods. Our results confirm that our unified approach improves accuracy over previous state-of-the-art results on patch matching datasets, while reducing the storage requirement for descriptors. We make pre-trained MatchNet publicly available.
Homepage: https://ieeexplore.ieee.org/document/7298948
Source Code:  https://github.com/hanxf/matchnet
Related Software: HPatches; TILDE; SuperPoint; LF-Net; Key.Net; L2-Net; FlowNet; BRISK; SURF; SIFT; PCA-SIFT; KITTI; ImageNet; SBERT; GLUE; SQuAD; GloVe; SOSNet; Theia; R2D2
Cited in: 5 Publications

Citations by Year