zbMATH — the first resource for mathematics

Analysis of parametric models. Linear methods and approximations. (English) Zbl 1444.47080
This is a high lever discussion of parametric models that have many applications such as optimal control, uncertainty quantification, model reduction, etc. The main purpose of the paper is to provide a survey and a unifying approach. In the abstract setting of the paper, the problem takes the form of a function \(r(p)\) in some Hilbert space \(\mathcal{U}\) depending on parameters \(p\) (e.g., \(r(p)\) is describing the state) and it is the unique solution of some equation \(F(r(p),p)=0\). The Hilbert space is essential because taking an inner product in \(\mathcal{U}\) allows to define a linear map \(R:u\mapsto \langle r(p),u\rangle \in\mathbb{R}\). Then a reproducing kernel or an orthonormal basis for \(\mathcal{U}\) can be defined. The operator \(C=R^*R\) is the correlation, which has a spectral decomposition, and can have several differential factorizations, giving rise to different (known) methods and techniques. The paper analyses the equivalence and relations between all these approaches and links these to known, seemingly different, methods and applications.

47N70 Applications of operator theory in systems, signals, circuits, and control theory
93C30 Control/observation systems governed by functional relations other than differential equations (such as hybrid and switching systems)
00A71 General theory of mathematical modeling
47A68 Factorization theory (including Wiener-Hopf and spectral factorizations) of linear operators
46E22 Hilbert spaces with reproducing kernels (= (proper) functional Hilbert spaces, including de Branges-Rovnyak and other structured spaces)
35B30 Dependence of solutions to PDEs on initial and/or boundary data and/or on parameters of PDEs
37M99 Approximation methods and numerical treatment of dynamical systems
41A45 Approximation by arbitrary linear expressions
41A63 Multidimensional problems (should also be assigned at least one other classification number from Section 41-XX)
60G20 Generalized stochastic processes
60G60 Random fields
65J99 Numerical analysis in abstract spaces
Full Text: DOI
[1] Ammar, A.; Chinesta, F.; Falcó, A., On the convergence of a greedy rank-one update algorithm for a class of linear systems, Arch. Computat. Methods Eng., 17, 473-486 (2010) · Zbl 1269.65120
[2] Atkinson, Ke, The Numerical Solution of Integral Equations of the Second Kind (1997), Cambridge: Cambridge University Press, Cambridge
[3] Benner, P.; Gugercin, S.; Willcox, K., A survey of projection-based model reduction methods for parametric dynamical systems, SIAM Rev., 57, 483-531 (2015) · Zbl 1339.37089
[4] Benner, Peter; Ohlberger, Mario; Patera, Anthony; Rozza, Gianluigi; Urban, Karsten, Model Reduction of Parametrized Systems (2017), Cham: Springer International Publishing, Cham · Zbl 1381.65001
[5] Berlinet, A.; Thomas-Agnan, C., Reproducing Kernel Hilbert Spaces in Probability and Statistics (2004), Dordrecht: Kluwer, Dordrecht · Zbl 1145.62002
[6] Bracewell, R.N.: The Fourier Transform and Its Applications. McGraw-Hill, New York NY (1978) · Zbl 0502.42001
[7] Chinesta, F.; Keunings, R.; Leygue, A., The Proper Generalized Decomposition for Advanced Numerical Simulations (2014), Berlin: Springer, Berlin · Zbl 1287.65001
[8] Chinesta, F.; Ladevèze, P.; Cueto, E., A short review on model order reduction based on proper generalized decomposition, Arch. Computat. Methods Eng., 18, 395-404 (2011)
[9] Cohen, N., Sharri, O., Shashua, A.: On the expressive power of deep learning: a tensor analysis. arXiv:1509.05009[cs.NE] (2016)
[10] Courant, R.; Hilbert, D., Methods of Mathematical Physics (1989), Chichester: Wiley, Chichester · Zbl 0729.00007
[11] Dautray, R.; Lions, Jl, Spectral Theory and Applications Mathematical Analysis and Numerical Methods for Science and Technology, vol. 3 (1990), Berlin: Springer, Berlin
[12] Espig, Mike; Hackbusch, Wolfgang; Litvinenko, Alexander; Matthies, Hermann G.; Zander, Elmar, Efficient Analysis of High Dimensional Data in Tensor Formats, Lecture Notes in Computational Science and Engineering, 31-56 (2012), Berlin, Heidelberg: Springer Berlin Heidelberg, Berlin, Heidelberg
[13] Gel’Fand, Im; Shilov, Ge, Properties and Operations Generalized Functions, vol. 1 (1964), New York: Academic Press, New York
[14] Gel’Fand, Im; Shilov, Ge, Theory of Differential Equations Generalized Functions, vol. 3 (1967), New York: Academic Press, New York
[15] Gel’Fand, Im; Shilov, Ge, Spaces of Fundamental and Generalized Functions. Generalized Functions, vol. 2 (1968), New York: Academic Press, New York
[16] Gel’Fand, Im; Vilenkin, Ny, Applications of Harmonic Analysis Generalized Functions, vol. 4 (1964), New York: Academic Press, New York
[17] Grasedyck, L., Hierarchical singular value decomposition of tensors, SIAM Journal on Matrix Analysis and Applications, 31, 2029-2054 (2010) · Zbl 1210.65090
[18] Grasedyck, L.; Kressner, D.; Tobler, C., A literature survey of low-rank tensor approximation techniques, GAMM-Mitteilungen, 36, 53-78 (2013) · Zbl 1279.65045
[19] Gross, L., Measurable functions on Hilbert space, Trans. Am. Math. Soc., 105, 3, 372-390 (1962) · Zbl 0178.50001
[20] Hackbusch, W., Tensor Spaces and Numerical Tensor Calculus (2012), Berlin: Springer, Berlin · Zbl 1244.65061
[21] Janson, S., Gaussian Hilbert Spaces. Cambridge Tracts in Mathematics, vol. 129 (1997), Cambridge: Cambridge University Press, Cambridge · Zbl 0887.60009
[22] Karhunen, K., Zur Spektraltheorie stochastischer Prozesse, Ann. Acad. Sci. Fennicae. Ser. A. I. Math.-Phys., 34, 1-7 (1946) · Zbl 0063.03144
[23] Karhunen, K., Über lineare Methoden in der Wahrscheinlichkeitsrechnung, Ann. Acad. Sci. Fennicae. Ser. A. I. Math.-Phys., 37, 1-79 (1947) · Zbl 0030.16502
[24] Karhunen, K., Über die Struktur stationärer zufälliger Funktionen, Arkiv för Matematik, 1, 141-160 (1950) · Zbl 0038.08603
[25] Karhunen, Kari; Santos, Francisco Oliva; Martín, Sebastián Ferrer, Metodos lineales en el Calculo de Probabilidades, Trabajos de Estadistica, 3, 1-2, 59-137 (1952) · Zbl 0047.12602
[26] Karhunen, K., Selin, I.: On linear methods in probability theory — Über lineare Methoden in der Wahrscheinlichkeitsrechnung — 1947. U.S. Air Force — Project RAND T-131, The RAND Corporation, St Monica, CA, USA. https://www.rand.org/pubs/translations/T131.html. Englisch Translation [23] (1960)
[27] Khrulkov, V., Novikov, A., Oseledets, I.: Expressive power of recurrent neural net-works. arXiv:1711.00811[cs.LG] (2018) · Zbl 06856780
[28] Krée, Paul; Soize, Christian, Mathematics of Random Phenomena (1986), Dordrecht: Springer Netherlands, Dordrecht · Zbl 0628.73099
[29] Ladevèze, P.; Chamoin, L., On the verification of model reduction methods based on the proper generalized decomposition, Comput. Methods Appl. Mech. Eng., 200, 23-24, 2032-2047 (2011) · Zbl 1228.76089
[30] Le Maître, Op; Knio, Om, Spectral Methods for Uncertainty Quantification. Scientific Computation (2010), Berlin: Springer, Berlin
[31] Loève, M., Fonctions alétoires de second ordre, C. R. Acad. Sci., 220, 295-296 (1945)
[32] Loève, M.: Fonctions alétoires de second ordre. C. R. Acad. Sci. 222 (1946) · Zbl 0063.03614
[33] Loève, Michel, Probability Theory II (1978), New York, NY: Springer New York, New York, NY · Zbl 1368.60005
[34] Luenberger, Dg, Optimization by Vector Space Methods (1969), Chichester: Wiley, Chichester
[35] Matthies, H.G.: Uncertainty quantification with stochastic finite elements. In: Stein, E., de Borst, R., Hughes, T.J.R. (eds.) Encyclopaedia of Computational Mechanics. 10.1002/0470091355.ecm071. Part 1. Fundamentals. Encyclopaedia of Computational Mechanics, vol. 1. Wiley, Chichester (2007)
[36] Matthies, H.G.: Uncertainty quantification and Bayesian inversion. In: Stein, E., de Borst, R., Hughes, T.J.R. (eds.) Encyclopaedia of Computational Mechanics. 2nd edn. 10.1002/9781119176817.ecm2071. Part 1. Fundamentals. Encyclopaedia of Computational Mechanics, vol. 1. Wiley, Chichester (2017)
[37] Dienstfrey, Andrew M.; Boisvert, Ronald F., Uncertainty Quantification in Scientific Computing (2012), Berlin, Heidelberg: Springer Berlin Heidelberg, Berlin, Heidelberg · Zbl 1254.65003
[38] Nouy, A., Proper generalized decompositions and separated representations for the numerical solution of high dimensional stochastic problems, Arch. Comput. Methods Eng., 17, 403-434 (2010) · Zbl 1269.76079
[39] Nouy, A.; Le Maître, Op, Generalized spectral decomposition for stochastic nonlinear problems, J. Comput. Phys., 228, 1, 202-235 (2009) · Zbl 1157.65009
[40] Oseledets, I., TT-cross approximation for multidimensional arrays, Linear Algebra Appl., 432, 70-88 (2010) · Zbl 1183.65040
[41] Oseledets, Iv, Tensor-train decomposition, SIAM J. Sci. Comput., 33, 5, 2295-2317 (2011) · Zbl 1232.15018
[42] Reed, M.; Simon, B., Fourier Analysis and Self-Adjointness, Methods of Modern Mathematical Physics, vol. II (1975), New York: Academic Press, New York
[43] Reed, M.; Simon, B., Functional Analysis, Methods of Modern Mathematical Physics, vol. I (1980), New York: Academic Press, New York
[44] Segal, Ie, Tensor algebras over Hilbert spaces I, Trans. Am. Math. Soc., 81, 1, 106-134 (1956) · Zbl 0099.12104
[45] Segal, Ie, Distributions in Hilbert space and canonical systems of operators, Trans. Am. Math. Soc., 88, 1, 12-41 (1958) · Zbl 0099.12104
[46] Segal, Ie, Nonlinear functions of weak processes. I, J. Funct. Anal., 4, 3, 404-456 (1969) · Zbl 0187.39201
[47] Segal, Ie; Kunze, Ra, Integrals and Operators (1978), Berlin: Springer, Berlin
[48] Smith, Rc, Uncertainty Quantification: Theory, Implementation, and Applications Computational Science & Engineering, vol. 12 (2014), Philadelphia: SIAM, Philadelphia
[49] Soize, C.; Farhat, C., A nonparametric probabilistic approach for quantifying uncertainties in low-dimensional and high-dimensional nonlinear models, Int. J. Numer. Methods Eng., 109, 837-888 (2017)
[50] Strang, G., Introduction to Applied Mathematics (1986), Wellesley: Wellesley-Cambridge Press, Wellesley · Zbl 0618.00015
[51] Xiu, D., Numerical Methods for Stochastic Computations: a Spectral Method Approach (2010), Princeton: Princeton University Press, Princeton · Zbl 1210.65002
[52] Yaglom, Am, Correlation Theory of Stationary and Related Random Functions I (1968), Berlin: Springer, Berlin
[53] Yaglom, Am, Correlation Theory of Stationary and Related Random Functions II (1968), Berlin: Springer, Berlin
[54] Yaglom, A.M.: An introduction to the theory of stationary random functions. Dover, Mineola, NY USA (2004)
[55] Yosida, K., Functional Analysis (1980), Berlin: Springer, Berlin · Zbl 0152.32102
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.