swMATH ID: 36963
Software Authors: Zichao Long, Yiping Lu, Xianzhong Ma, Bin Dong
Description: PDE-Net: Learning PDEs from Data. In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two objectives at the same time: to accurately predict dynamics of complex systems and to uncover the underlying hidden PDE models. The basic idea of the proposed PDE-Net is to learn differential operators by learning convolution kernels (filters), and apply neural networks or other machine learning methods to approximate the unknown nonlinear responses. Comparing with existing approaches, which either assume the form of the nonlinear response is known or fix certain finite difference approximations of differential operators, our approach has the most flexibility by learning both differential operators and the nonlinear responses. A special feature of the proposed PDE-Net is that all filters are properly constrained, which enables us to easily identify the governing PDE models while still maintaining the expressive and predictive power of the network. These constrains are carefully designed by fully exploiting the relation between the orders of differential operators and the orders of sum rules of filters (an important concept originated from wavelet theory). We also discuss relations of the PDE-Net with some existing networks in computer vision such as Network-In-Network (NIN) and Residual Neural Network (ResNet). Numerical experiments show that the PDE-Net has the potential to uncover the hidden PDE of the observed dynamics, and predict the dynamical behavior for a relatively long time, even in a noisy environment.
Homepage: https://arxiv.org/abs/1710.09668
Source Code:  https://github.com/ZichaoLong/PDE-Net
Dependencies: Python
Keywords: Numerical Analysis; arXiv_math.NA; Machine Learning; arXiv_cs.LG; arXiv_cs.NE; arXiv_stat.ML; PDEs from Data
Related Software: DGM; Adam; TensorFlow; PyTorch; DeepONet; AlexNet; ImageNet; torchdiffeq; DeepXDE; U-Net; FPINNs; MgNet; Keras; DiffSharp; darch; VAMPnets; L-BFGS; NSFnets; SINDy; GitHub
Cited in: 95 Publications
all top 5

Cited by 232 Authors

8 Xiu, Dongbin
5 Jentzen, Arnulf
5 Wu, Kailiang
4 Chen, Zhen
4 Zhang, Dongxiao
3 Arridge, Simon R.
3 Hutzenthaler, Martin
3 Karniadakis, George Em
3 Koutsourelakis, Phaedon-Stelios
3 Lu, Jianfeng
3 Qin, Tong
3 Xu, Hao
3 Ying, Lexing
2 Adams, Nikolaus A.
2 Ayed, Ibrahim
2 Bazant, Martin Z.
2 Beck, Christian
2 Becker, Sebastian
2 Chang, Haibin
2 Darbon, Jerome
2 de Bézenac, Emmanuel
2 Dong, Bin
2 Gallinari, Patrick
2 Hesthaven, Jan S.
2 Kang, Sung Ha
2 Khoo, Yuehaw
2 Kruse, Thomas
2 Li, Yingzhou
2 Liao, Wenjing
2 Liu, Yingjie
2 Liu, Yongming
2 Lu, Lu
2 Meng, Tingwei
2 Perdikaris, Paris G.
2 Ray, Deep
2 Schaeffer, Hayden
2 Stuart, Andrew M.
2 Wang, Jianxun
2 Wang, Nanzhe
2 Xiao, Heng
2 Zhang, Linan
1 Alla, Alessandro
1 Aragon-Calvo, Miguel A.
1 Baharifard, Fatemeh
1 Bao, Feng
1 Barati Farimani, Amir
1 Bennett, Kane C.
1 Bezgin, Deniz A.
1 Bocquet, Marc
1 Bortz, David M.
1 Both, Gert-Jan
1 Botsas, Themistoklis
1 Braatz, Richard D.
1 Braunwarth, Ramon
1 Brunton, Steven L.
1 Cai, Shengze
1 Cai, Weihua
1 Chen, Yifan
1 Chen, Yu
1 Chen, Yuntian
1 Cheng, Xiuyuan
1 Cheridito, Patrick
1 Choi, Youngsoo
1 Chou, Ching-Shan
1 Choudhury, Subham
1 Churchill, Victor
1 Cotter, Andrew
1 Cox, Ben T.
1 Cui, Tao
1 Cyr, Eric C.
1 Dona, Jérémie
1 Dong, Guozhi
1 Du, Qiang
1 Fan, Yuwei
1 Farchi, Alban
1 Felsberger, Lukas
1 Forgione, Marco
1 Funke, Simon W.
1 Gao, Han
1 Gao, Yi
1 Germann, Timothy Clark
1 Ghodsi, Ali
1 Gibou, Frédéric
1 Glasner, Karl B.
1 Grohs, Philipp
1 Gulian, Mamikon
1 Guo, Zhiwei
1 Gupta, Maya R.
1 Hähnel, Philipp
1 Hajimohammadi, Zeinab
1 Han, Jiequn
1 Hauptmann, Andreas
1 He, Juncai
1 He, Yuchen
1 Hintermüller, Michael
1 Hong, Liu
1 Hornung, Fabian
1 Hosseini, Bamdad
1 Hu, Jiawei
1 Hu, Pipi
...and 132 more Authors
all top 5

Cited in 37 Serials

39 Journal of Computational Physics
8 SIAM Journal on Scientific Computing
6 Computer Methods in Applied Mechanics and Engineering
5 Communications in Computational Physics
2 Physica D
2 Journal of Scientific Computing
2 Journal of Machine Learning Research (JMLR)
2 Multiscale Modeling & Simulation
1 Computers & Mathematics with Applications
1 Bulletin of Mathematical Biology
1 Chaos, Solitons and Fractals
1 Applied Mathematics and Computation
1 SIAM Journal on Numerical Analysis
1 European Journal of Applied Mathematics
1 Machine Learning
1 MSCS. Mathematical Structures in Computer Science
1 SIAM Journal on Applied Mathematics
1 SIAM Review
1 Journal of Mathematical Imaging and Vision
1 Computational and Applied Mathematics
1 ETNA. Electronic Transactions on Numerical Analysis
1 Advances in Computational Mathematics
1 European Journal of Control
1 European Series in Applied and Industrial Mathematics (ESAIM): Control, Optimization and Calculus of Variations
1 Computational Geosciences
1 Foundations of Computational Mathematics
1 Journal of Numerical Mathematics
1 SIAM Journal on Applied Dynamical Systems
1 Acta Numerica
1 Journal of Statistical Mechanics: Theory and Experiment
1 Discrete and Continuous Dynamical Systems. Series S
1 Science China. Mathematics
1 Journal of the Operations Research Society of China
1 Research in the Mathematical Sciences
1 Communications on Applied Mathematics and Computation
1 SN Partial Differential Equations and Applications
1 Foundations of Data Science

Citations by Year