RMSprop swMATH ID: 22204 Software Authors: Tijmen Tieleman; Geoffrey Hinton Description: RMSprop: Divide the gradient by a running average of its recent magnitude. RmsProp [tieleman2012rmsprop] is an optimizer that utilizes the magnitude of recent gradients to normalize the gradients. Homepage: http://climin.readthedocs.io/en/latest/rmsprop.html#tieleman2012rmsprop Related Software: Adam; AdaGrad; ADADELTA; TensorFlow; PyTorch; GitHub; AlexNet; ImageNet; Keras; MNIST; CIFAR; L-BFGS; Theano; Saga; PRMLT; darch; Fashion-MNIST; SGD-QN; UCI-ml; ADVI Cited in: 74 Publications all top 5 Cited by 205 Authors 3 Yan, Liang 3 Zhou, Tao 2 Barakat, Anas 2 Bianchi, Pascal 2 Bilionis, Ilias 2 Curtis, Frank E. 2 Elsheikh, Ahmed H. 2 Fedkiw, Ronald P. 2 Lee, Jaehong 2 Liu, Hailiang 2 Osher, Stanley Joel 2 Roosta, Fred 2 Schnürch, Simon 2 Tripathy, Rohit K. 2 Wang, Bao 1 Ahn, Changwook 1 Ammar, Haitham Bou 1 Antonietti, Paola Francesca 1 Baesens, Bart 1 Baldassi, Carlo 1 Bao, Michael 1 Baraniuk, Richard G. 1 Baydin, Atılım Güneş 1 Belotto da Silva, André Ricardo 1 Bengio, Yoshua 1 Bernardo, Felipe 1 Berrada, Leonard 1 Bertozzi, Andrea Louise 1 Blei, David M. 1 Borges, Marcio R. 1 Borgs, Christian 1 Borisyak, Maxim 1 Bottou, Léon 1 Caldana, Matteo 1 Carlberg, Kevin T. 1 Chakraborty, Souvik 1 Chaudhari, Pratik 1 Chayes, Jennifer Tour 1 Chen, Jingrun 1 Chen, Yunmei 1 Chen, Zengping 1 Cheng, Lizhi 1 Cho, Kyunghyun 1 Choromanska, Anna 1 Chouzenoux, Emilie 1 Ciosek, Kamil 1 Cowen-Rivers, Alexander I. 1 Cui, Tao 1 Dai, Yu-Hong 1 Dede’, Luca 1 Deng, Wei 1 Derkach, Denis 1 Do, Dieu T. T. 1 Duan, Shiyu 1 Duruisseaux, Valentin 1 Fang, Chih-Hao 1 Fest, Jean-Baptiste 1 Fischer, Thomas Georg Bert 1 Flori, Andrea 1 Foster, Adam 1 Galeano, Pedro 1 Gazeau, Maxime 1 Geng, Zhenglin 1 Giraldi, Gilson Antonio 1 Goda, Takashi 1 Grabocka, Josif 1 Grama, Ananth Y. 1 Griffiths, Ryan-Rhys 1 Grosnit, Antoine 1 Gülçehre, Çağlar 1 Gunnarsson, Björn Rafn 1 Ha, Jingwan 1 Hachem, Walid 1 He, Juanjuan 1 Heber, Frederik 1 Heck, Linus 1 Heldmann, Fabian 1 Hironaka, Tomohiko 1 Hoffman, Matthew D. 1 Hyde, David A. B. 1 Iiduka, Hideaki 1 Jiang, Bo 1 Jing, Li 1 Jomaa, Hadi S. 1 Junges, Sebastian 1 Kang, Dongseok 1 Karumuri, Sharmila 1 Katoen, Joost-Pieter 1 Kejzlar, Vojtech 1 Kim, Sehwan 1 Kitade, Wataru 1 Klamroth, Kathrin 1 Korn, Ralf 1 Kovachki, Nikola B. 1 Krauss, Christopher 1 Kumar, M. Pawan 1 Kurihara, Masahito 1 Kylasa, Sudhir 1 Lakhmiri, Dounia 1 Le Digabel, Sébastien ...and 105 more Authors all top 5 Cited in 41 Serials 13 Journal of Machine Learning Research (JMLR) 8 Journal of Computational Physics 3 Neural Computation 3 European Journal of Operational Research 3 SIAM Journal on Optimization 2 SIAM Journal on Scientific Computing 2 Optimization Methods & Software 2 Computational Geosciences 2 Journal of Statistical Mechanics: Theory and Experiment 2 Communications in Computational Physics 1 Computers & Mathematics with Applications 1 Computer Methods in Applied Mechanics and Engineering 1 Psychometrika 1 ACM Transactions on Mathematical Software 1 Information Sciences 1 Journal of Differential Equations 1 Journal of Optimization Theory and Applications 1 Journal of Computational Mathematics 1 Computers & Operations Research 1 Journal of Scientific Computing 1 Journal of Global Optimization 1 Numerical Algorithms 1 Applied Mathematical Modelling 1 Journal of Statistical Computation and Simulation 1 SIAM Review 1 Computational Statistics and Data Analysis 1 Applied Mathematical Finance 1 INFORMS Journal on Computing 1 Vietnam Journal of Mathematics 1 Data Mining and Knowledge Discovery 1 Archives of Computational Methods in Engineering 1 ASTIN Bulletin 1 International Journal of Wavelets, Multiresolution and Information Processing 1 Electronic Journal of Statistics 1 SIAM Journal on Imaging Sciences 1 Mathematical Programming Computation 1 Statistics and Computing 1 Journal of the Operations Research Society of China 1 Research in the Mathematical Sciences 1 Annals of Applied Mathematics 1 Computational and Mathematical Biophysics all top 5 Cited in 19 Fields 44 Computer science (68-XX) 27 Numerical analysis (65-XX) 23 Operations research, mathematical programming (90-XX) 20 Statistics (62-XX) 6 Partial differential equations (35-XX) 6 Biology and other natural sciences (92-XX) 5 Game theory, economics, finance, and other social and behavioral sciences (91-XX) 4 Calculus of variations and optimal control; optimization (49-XX) 4 Probability theory and stochastic processes (60-XX) 3 Dynamical systems and ergodic theory (37-XX) 3 Fluid mechanics (76-XX) 2 Ordinary differential equations (34-XX) 2 Mechanics of deformable solids (74-XX) 1 General and overarching topics; collections (00-XX) 1 Mechanics of particles and systems (70-XX) 1 Statistical mechanics, structure of matter (82-XX) 1 Geophysics (86-XX) 1 Systems theory; control (93-XX) 1 Information and communication theory, circuits (94-XX) Citations by Year