BigGAN swMATH ID: 43463 Software Authors: Andrew Brock, Jeff Donahue, Karen Simonyan Description: Large Scale GAN Training for High Fidelity Natural Image Synthesis. Despite recent progress in generative image modeling, successfully generating high-resolution, diverse samples from complex datasets such as ImageNet remains an elusive goal. To this end, we train Generative Adversarial Networks at the largest scale yet attempted, and study the instabilities specific to such scale. We find that applying orthogonal regularization to the generator renders it amenable to a simple ”truncation trick,” allowing fine control over the trade-off between sample fidelity and variety by reducing the variance of the Generator’s input. Our modifications lead to models which set the new state of the art in class-conditional image synthesis. When trained on ImageNet at 128x128 resolution, our models (BigGANs) achieve an Inception Score (IS) of 166.5 and Frechet Inception Distance (FID) of 7.4, improving over the previous best IS of 52.52 and FID of 18.6. Homepage: https://arxiv.org/abs/1809.11096 Source Code: https://github.com/ajbrock/BigGAN-PyTorch Dependencies: Python; PyTorch Related Software: Wasserstein GAN; StyleGAN; pix2pix; CycleGAN; ImageNet; Adam; InfoGAN; PyTorch; MNIST; TensorFlow; AttnGAN; GitHub; Fashion-MNIST; SeqGAN; LOGAN; Caffe; MMD GAN; sngan_projection; CIFAR; VEEGAN Cited in: 19 Publications all top 5 Cited by 97 Authors 1 Ahamed, Razia 1 Alajaji, Fady 1 Anirudh, Rushil 1 Back, Trevor 1 Bang, Duhyeon 1 Batina, Lejla 1 Beauguerlange, Nathalie 1 Benaim, Sagie 1 Benny, Yaniv 1 Biau, Gérard 1 Boedihardjo, March T. 1 Bouton, Simon 1 Bremer, Peer-Timo 1 Bridgland, Alex 1 Broshear, Jackson 1 Burlina, Philippe 1 Cao, Jiezhang 1 Cao, Kris 1 Connor, Jerome J. 1 Couillet, Romain 1 Dall’Amico, Lorenzo 1 Darve, Eric 1 De Vylder, Bart 1 Dutta, Praneet 1 Elie, Romuald 1 Elsheikh, Ahmed H. 1 Eslami, S. M. Ali 1 Fleet, David J. 1 Galanti, Tomer 1 Galashov, Alexandre 1 Garnelo, Marta 1 Graepel, Thore 1 Haber, Eldad 1 Hassabis, Demis 1 Heess, Nicolas 1 Hennes, Daniel 1 Ho, Jonathan 1 Hou, Thomas Yizhao 1 Hu, Xiping 1 Jaegle, Andrew 1 Kailkhura, Bhavya 1 Kang, Seoungyoon 1 Kong, Yinan 1 Lam, Ka Chun 1 Lensink, Keegan 1 Li, Jincheng 1 Li, Wuchen 1 Liu, Shu 1 Luc, Pauline 1 Mir, Roohie Naaz 1 Moreno, Pol 1 Mukhtar, Naila 1 Munos, Rémi 1 Norouzi, MohammadJavad 1 Omidshafiei, Shayegan 1 Paul, William 1 Pereyra, Marcelo 1 Perolat, Julien 1 Peters, Bas 1 Picek, Stjepan 1 Qiu, Kexin 1 Recasens, Adria 1 Rowland, Mark 1 Saharia, Chitwan 1 Salimans, Tim 1 Sangnier, Maxime 1 Sharma, Vipul 1 Shim, Hyunjung 1 Spearman, William 1 Sprechmann, Pablo 1 Steel, Dafydd 1 Strohmer, Thomas 1 Sun, Chengjie 1 Tan, Mingkui 1 Tanielian, Ugo 1 Thiagarajan, Jayaraman J. 1 Thornton, Gregory 1 Tremblay, Nicolas 1 Tuyls, Karl 1 Valko, Michal 1 Vershynin, Roman 1 Wang, Baoxun 1 Wang, I-Jeng 1 Wang, Zhe 1 Waskett, Tim 1 Wolf, Lior 1 Wu, Xiangmiao 1 Xu, Kailai 1 Xu, Zhen 1 Zha, Hongyuan 1 Zhang, Deyuan 1 Zhang, Huan 1 Zhang, Pengchuan 1 Zhang, Shumao 1 Zhou, Hao-Min 1 Zhu, Weiqiang 1 Zygalakis, Konstantinos C. all top 5 Cited in 13 Serials 3 International Journal of Computer Vision 3 Journal of Machine Learning Research (JMLR) 2 Research in the Mathematical Sciences 1 SIAM Journal on Numerical Analysis 1 Computational Mechanics 1 Machine Learning 1 Neural Computation 1 The Journal of Artificial Intelligence Research (JAIR) 1 Computational Geosciences 1 Journal of Statistical Mechanics: Theory and Experiment 1 SIAM Journal on Imaging Sciences 1 Computer Science Review 1 SIAM Journal on Mathematics of Data Science all top 5 Cited in 9 Fields 17 Computer science (68-XX) 3 Statistics (62-XX) 3 Numerical analysis (65-XX) 3 Information and communication theory, circuits (94-XX) 2 Partial differential equations (35-XX) 2 Calculus of variations and optimal control; optimization (49-XX) 2 Probability theory and stochastic processes (60-XX) 1 Statistical mechanics, structure of matter (82-XX) 1 Geophysics (86-XX) Citations by Year