DeepLab swMATH ID: 15303 Software Authors: Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, Alan L. Yuille Description: DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First, we highlight convolution with upsampled filters, or ’atrous convolution’, as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second, we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third, we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed ”DeepLab” system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7 Homepage: http://arxiv.org/abs/1606.00915 Source Code: https://github.com/google-research/deeplab2 Keywords: Computer Vision; Pattern Recognition; arXiv_cs.CV; DeepLab2; TensorFlow Library; Python; Deep Labeling Related Software: ImageNet; Faster R-CNN; MS-COCO; AlexNet; U-Net; PASCAL VOC; TensorFlow; SegNet; Adam; RefineNet; Cityscapes; GrabCut; PyTorch; KITTI; OverFeat; ADE20k; SIFT; SSD; PointNet; ShuffleNet Cited in: 45 Publications Standard Articles 1 Publication describing the Software Year DeepLab2: A TensorFlow Library for Deep Labeling Mark Weber, Huiyu Wang, Siyuan Qiao, Jun Xie, Maxwell D. Collins, Yukun Zhu, Liangzhe Yuan, Dahun Kim, Qihang Yu, Daniel Cremers, Laura Leal-Taixe, Alan L. Yuille, Florian Schroff, Hartwig Adam, Liang-Chieh Chen 2021 all top 5 Cited by 148 Authors 3 Fan, Yuwei 3 Lindeberg, Tony 3 Liu, Jun 3 Ying, Lexing 2 Lin, Lin 2 Tai, Xuecheng 2 Tang, Yuanyan 2 Torr, Philip H. S. 2 Wang, Xiaogang 2 Yang, Ming-Hsuan 2 Zepeda-Núñez, Leonardo 1 Ahsan, Unaiza 1 Ajanthan, Thalaiyasingam 1 Ali, Haider 1 Arnab, Anurag 1 Audebert, Nicolas 1 Babu, Gutti Jogesh 1 Behnke, Sven 1 Berman, Maxim 1 Blaschko, Matthew B. 1 Bloch, Anthony Michael 1 Bouguila, Nizar 1 Boulch, Alexandre 1 Bragantini, Jordão 1 Bunel, Rudy 1 Burgard, Wolfram 1 Cao, Yan 1 Caseria, Brendan J. 1 Castillo-Navarro, Javiera 1 Chanda, Bhabatosh 1 Chen, Jie 1 Chen, Penghe 1 Chen, Xilin 1 Chen, Yiwen 1 Chen, Zhe 1 Chidlovskii, Boris 1 Cho, Hyunsoon 1 Csurka, Gabriela 1 Deng, Dongdong 1 Desmaison, Alban 1 Falcão, Alexandre Xavier 1 Fang, Bin 1 Feliu-Fabà, Jordi 1 Fieguth, Paul W. 1 Fu, Zhenyin 1 Galliani, Silvano 1 Gao, Yongsheng 1 Ghaffari, Maani 1 Guo, Jianyuan 1 Guo, Ruchi 1 Hackel, Timo 1 Hagen, Matthew 1 Han, Jungong 1 He, Lingxiao 1 Herty, Michael Matthias 1 Huang, Haiyang 1 Huang, Lang 1 Hussain, Ibrar 1 Jansson, Ylva 1 Ji, Shuiwang 1 Jia, Fan 1 Jiang, Jiahua 1 Jin, Dequan 1 Joy, Thomas 1 Kahl, Fredrik 1 Kalsi, Jaspreet Singh 1 Khan, Muhammad Shahkar 1 Khatri, Rajendra K. C. 1 Kohli, Pushmeet 1 Kumar, M. Pawan 1 Larsson, Måns 1 Le Saux, Bertrand 1 Lefèvre, Sébastien 1 Li, Haiqing 1 Li, Hanyan 1 Li, Jingyu 1 Li, Zhibin 1 Lin, Yen-Yu 1 Lin, Zhiping 1 Liu, Sifei 1 Liu, Xiaoyu 1 Liu, Xinwang 1 Liu, Zhiyong 1 Lou, Yifei 1 Luo, Jiebo 1 Luo, Ping 1 Luo, Ruyi 1 Ma, Huimin 1 Ma, Xindi 1 Mohan, Rohit 1 Mondal, Ranjan 1 Nie, Yan 1 Niu, Sijie 1 Orozco Bohorquez, Cindy 1 Ouyang, Wanli 1 Pareschi, Lorenzo 1 Pietikäinen, Matti 1 Purkait, Pulak 1 Qin, Ziyan 1 Quenzel, Jan ...and 48 more Authors all top 5 Cited in 21 Serials 12 International Journal of Computer Vision 4 Journal of Mathematical Imaging and Vision 4 SIAM Journal on Imaging Sciences 2 Neural Computation 2 International Journal of Wavelets, Multiresolution and Information Processing 2 Inverse Problems and Imaging 2 Foundations and Trends in Computer Graphics and Vision 1 Journal of Computational Physics 1 Journal of the Franklin Institute 1 Machine Learning 1 SIAM Journal on Scientific Computing 1 Data Mining and Knowledge Discovery 1 IEEE Transactions on Image Processing 1 Journal of Machine Learning Research (JMLR) 1 Multiscale Modeling & Simulation 1 Analysis and Applications (Singapore) 1 Mathematical Biosciences and Engineering 1 Networks and Heterogeneous Media 1 Journal of Statistical Theory and Practice 1 Research in the Mathematical Sciences 1 Texts in Computer Science all top 5 Cited in 13 Fields 38 Computer science (68-XX) 8 Information and communication theory, circuits (94-XX) 6 Biology and other natural sciences (92-XX) 5 Statistics (62-XX) 5 Numerical analysis (65-XX) 4 Partial differential equations (35-XX) 3 Operations research, mathematical programming (90-XX) 2 Statistical mechanics, structure of matter (82-XX) 1 Dynamical systems and ergodic theory (37-XX) 1 Probability theory and stochastic processes (60-XX) 1 Optics, electromagnetic theory (78-XX) 1 Game theory, economics, finance, and other social and behavioral sciences (91-XX) 1 Systems theory; control (93-XX) Citations by Year