neural-tangents swMATH ID: 39529 Software Authors: Roman Novak, Lechao Xiao, Jiri Hron, Jaehoon Lee, Alexander A. Alemi, Jascha Sohl-Dickstein, Samuel S. Schoenholz Description: Neural Tangents: Fast and Easy Infinite Neural Networks in Python. Neural Tangents is a library designed to enable research into infinite-width neural networks. It provides a high-level API for specifying complex and hierarchical neural network architectures. These networks can then be trained and evaluated either at finite-width as usual or in their infinite-width limit. Infinite-width networks can be trained analytically using exact Bayesian inference or using gradient descent via the Neural Tangent Kernel. Additionally, Neural Tangents provides tools to study gradient descent training dynamics of wide but finite networks in either function space or weight space. The entire library runs out-of-the-box on CPU, GPU, or TPU. All computations can be automatically distributed over multiple accelerators with near-linear scaling in the number of devices. Neural Tangents is available at https://github.com/google/neural-tangents. We also provide an accompanying interactive Colab notebook. Homepage: https://arxiv.org/abs/1912.02803 Source Code: https://github.com/google/neural-tangents Dependencies: Python Keywords: Machine Learning; arXiv_stat.ML; arXiv_cs.LG; Python; Neural Tangents; Infinite Neural Networks; interactive Colab notebook Related Software: TensorFlow; PyTorch; JAX; Python; Adam; ImageNet; GitHub; Stax; AlexNet; BERT; PINN; PhyGeoNet; PPINN; TensorDiffEq; PINNsNTK; Horovod; ADCME; EikoNet; PINNeik; DeepONet Cited in: 5 Publications Standard Articles 1 Publication describing the Software Year Neural Tangents: Fast and Easy Infinite Neural Networks in Python Roman Novak, Lechao Xiao, Jiri Hron, Jaehoon Lee, Alexander A. Alemi, Jascha Sohl-Dickstein, Samuel S. Schoenholz 2019 all top 5 Cited by 20 Authors 1 Bahri, Yasaman 1 Cuomo, Salvatore 1 Fan, Yuwei 1 Ghorbani, Behrooz 1 Giampaolo, Fabio 1 Lee, Jaehoon 1 Li, Zhihan 1 Mei, Song 1 Misiakiewicz, Theodor 1 Novak, Roman 1 Pennington, Jeffrey S. 1 Piccialli, Francesco 1 Raissi, Maziar 1 Rozza, Gianluigi 1 Schiano Di Cola, Vincenzo 1 Schoenholz, Samuel S. 1 Sohl-Dickstein, Jascha 1 Sun, Ruoyu 1 Xiao, Lechao 1 Ying, Lexing Cited in 4 Serials 2 Journal of Statistical Mechanics: Theory and Experiment 1 Journal of Scientific Computing 1 Multiscale Modeling & Simulation 1 Journal of the Operations Research Society of China all top 5 Cited in 6 Fields 3 Computer science (68-XX) 2 Numerical analysis (65-XX) 2 Statistical mechanics, structure of matter (82-XX) 1 Partial differential equations (35-XX) 1 Statistics (62-XX) 1 Operations research, mathematical programming (90-XX) Citations by Year