AdaGAN swMATH ID: 42573 Software Authors: Ilya Tolstikhin, Sylvain Gelly, Olivier Bousquet, Carl-Johann Simon-Gabriel, Bernhard Schölkopf Description: AdaGAN: Boosting Generative Models. Generative Adversarial Networks (GAN) (Goodfellow et al., 2014) are an effective method for training generative models of complex data such as natural images. However, they are notoriously hard to train and can suffer from the problem of missing modes where the model is not able to produce examples in certain regions of the space. We propose an iterative procedure, called AdaGAN, where at every step we add a new component into a mixture model by running a GAN algorithm on a reweighted sample. This is inspired by boosting algorithms, where many potentially weak individual predictors are greedily aggregated to form a strong composite predictor. We prove that such an incremental procedure leads to convergence to the true distribution in a finite number of steps if each step is optimal, and convergence at an exponential rate otherwise. We also illustrate experimentally that this procedure addresses the problem of missing modes. Homepage: https://arxiv.org/abs/1701.02386 Source Code: https://github.com/tolstikhin/adagan Dependencies: Python Related Software: Wasserstein GAN; pix2pix; CycleGAN; VEEGAN; TensorFlow; CopulaModel; Adam; TwoCop; QRM; AugGAN; StyleGAN; PULSE; Celeb-DF; carpedm20; BAGAN; FaceForensics; MesoNet; MGAN; ProbGAN; LSUN Cited in: 6 Publications all top 5 Cited by 23 Authors 1 Cui, Li 1 Firoozye, Nick 1 Glaws, Andrew 1 Gu, Xianfeng David 1 Hassanaly, Malik 1 Hofert, Marius 1 Jain, Niharika 1 Jiao, Jiantao 1 Kambhampati, Subbarao 1 King, Ryan N. 1 Koshiyama, Adriano 1 Lei, Na 1 Manikonda, Lydia 1 Olmo, Alberto 1 Prasad, Avinash 1 Sengupta, Sailik 1 Stengel, Karen 1 Su, Kehua 1 Treleaven, Philip 1 Tse, David N. C. 1 Yau, Shing-Tung 1 Zhu, Banghua 1 Zhu, Mu all top 5 Cited in 6 Serials 1 Artificial Intelligence 1 IEEE Transactions on Information Theory 1 Journal of Computational Physics 1 Computer Aided Geometric Design 1 Quantitative Finance 1 Journal of Computational and Graphical Statistics all top 5 Cited in 6 Fields 2 Calculus of variations and optimal control; optimization (49-XX) 2 Statistics (62-XX) 2 Computer science (68-XX) 1 Numerical analysis (65-XX) 1 Fluid mechanics (76-XX) 1 Game theory, economics, finance, and other social and behavioral sciences (91-XX) Citations by Year