Inception-v4 swMATH ID: 39592 Software Authors: Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, Alex Alemi Description: Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Very deep convolutional networks have been central to the largest advances in image recognition performance in recent years. One example is the Inception architecture that has been shown to achieve very good performance at relatively low computational cost. Recently, the introduction of residual connections in conjunction with a more traditional architecture has yielded state-of-the-art performance in the 2015 ILSVRC challenge; its performance was similar to the latest generation Inception-v3 network. This raises the question of whether there are any benefit in combining the Inception architecture with residual connections. Here we give clear empirical evidence that training with residual connections accelerates the training of Inception networks significantly. There is also some evidence of residual Inception networks outperforming similarly expensive Inception networks without residual connections by a thin margin. We also present several new streamlined architectures for both residual and non-residual Inception networks. These variations improve the single-frame recognition performance on the ILSVRC 2012 classification task significantly. We further demonstrate how proper activation scaling stabilizes the training of very wide residual Inception networks. With an ensemble of three residual and one Inception-v4, we achieve 3.08 percent top-5 error on the test set of the ImageNet classification (CLS) challenge Homepage: https://paperswithcode.com/paper/inception-v4-inception-resnet-and-the-impact Related Software: ImageNet; Adam; AlexNet; Caffe; MS-COCO; TensorFlow; Keras; Xception; MobileNets; YOLO; PyTorch; ShuffleNet; SqueezeNet; SSD; U-Net; GitHub; MobileNetV2; XNOR-Net; CIFAR; Faster R-CNN Cited in: 28 Publications all top 5 Cited by 107 Authors 2 Wang, Xiaogang 2 Zhang, Hao 1 Abdedou, Azzedine 1 Agostini, Alejandro 1 Alsing, Justin 1 Amerini, Irene 1 Anagnostopoulos, Aris 1 Anderson, Lovis 1 Aziz-ur-Rehman 1 Bilionis, Ilias 1 Bohn, Bastian 1 Cauchois, Maxime 1 Celsi, Lorenzo Ricciardi 1 Chae, Kum Ju 1 Chan, Raymond Hon-Fu 1 Charnock, Tom 1 Chen, Jiaxin 1 Chen, Jie 1 Choi, Younhee 1 Chung, Tsz Shun Eric 1 Delmas, Vincent 1 Ding, Xiaofeng 1 Ding, Yijie 1 Duchi, John C. 1 El Hibaoui, Abdelaaziz 1 Fan, Cien 1 Fauth, Michael 1 Fieguth, Paul W. 1 Frasconi, Paolo 1 Gao, Hewei 1 Gao, Rui 1 Griebel, Michael 1 Guan, Shixuan 1 Gupta, Suyash 1 He, Juanjuan 1 Hou, Xingsong 1 Hu, Hui 1 Huan, Er-Yang 1 Jacquier, Pierre 1 Jäger, Manfred 1 Jiang, Tengsheng 1 Jin, Gong Yong 1 Kannan, Dinesh 1 Karimov, Khasan S. 1 Karumuri, Sharmila 1 Ko, Seok-Bum 1 Koch, Thorsten 1 Lavrač, Nada 1 Leung, Wingtat 1 Li, Haiou 1 Li, Jingyu 1 Liu, Junkai 1 Liu, Li 1 Liu, Xinwang 1 Liu, Yifeng 1 Lu, Yaoyao 1 Lüddecke, Timo 1 Luo, Ping 1 Maiano, Luca 1 Makinen, T. Lucas 1 Martinc, Matej 1 Mir, Roohie Naaz 1 Ouyang, Wanli 1 Panchal, Jitesh H. 1 Peng, Yaxin 1 Pietikäinen, Matti 1 Pollak, Senja 1 Pun, Saimang 1 Qin, Jie 1 Rawat, Waseem 1 Ren, Jiamin 1 Ruehle, Fabian 1 Sajid, Muhammad 1 Salam, Abdulwahed 1 Schmidt-Hieber, Johannes 1 Shao, Ling 1 Shao, Wenqi 1 Sharma, Vipul 1 Shi, Yu 1 Škrlj, Blaž 1 Soulaimani, Azzeddine 1 Sun, Caixia 1 Szeliski, Richard 1 Taj, Imtiaz Ahmad 1 Tamosiunaite, Minija 1 Tibo, Alessandro 1 Tripathy, Rohit K. 1 Turner, Mark G. 1 Wandelt, Benjamin D. 1 Wang, Sen 1 Wang, Yi 1 Wang, Zenghui 1 Wen, Guihua 1 Wörgötter, Florentin 1 Wu, Hongjie 1 Xiang, Song 1 Xing, Yuxiang 1 Yan, Jun 1 Yang, Hongfei 1 Zeng, Tie Yong ...and 7 more Authors all top 5 Cited in 22 Serials 2 Journal of Computational Physics 2 International Journal of Computer Vision 2 Journal of Machine Learning Research (JMLR) 2 International Journal of Wavelets, Multiresolution and Information Processing 2 Mathematical Biosciences and Engineering 2 Computational & Mathematical Methods in Medicine 1 Artificial Intelligence 1 Physics Reports 1 The Annals of Statistics 1 Journal of Computational and Applied Mathematics 1 Mathematics and Computers in Simulation 1 Multidimensional Systems and Signal Processing 1 Machine Learning 1 Neural Computation 1 Mathematical Methods of Operations Research 1 IEEE Transactions on Image Processing 1 Journal of Cosmology and Astroparticle Physics 1 Inverse Problems and Imaging 1 Foundations and Trends in Computer Graphics and Vision 1 Computer Science Review 1 Texts in Computer Science 1 SIAM Journal on Mathematics of Data Science all top 5 Cited in 15 Fields 25 Computer science (68-XX) 7 Biology and other natural sciences (92-XX) 3 Statistics (62-XX) 3 Numerical analysis (65-XX) 2 Information and communication theory, circuits (94-XX) 1 Partial differential equations (35-XX) 1 Harmonic analysis on Euclidean spaces (42-XX) 1 Algebraic topology (55-XX) 1 Probability theory and stochastic processes (60-XX) 1 Mechanics of deformable solids (74-XX) 1 Fluid mechanics (76-XX) 1 Quantum theory (81-XX) 1 Relativity and gravitational theory (83-XX) 1 Geophysics (86-XX) 1 Operations research, mathematical programming (90-XX) Citations by Year