×

Estimation and control of dynamical systems. (English) Zbl 1401.37001

Interdisciplinary Applied Mathematics 48. Cham: Springer (ISBN 978-3-319-75455-0/hbk; 978-3-319-75456-7/ebook). xii, 547 p. (2018).
This book considers modeling and control problems of dynamical systems. The situation in which the input-output relationship is obtained through the evolution of a state variable is considered. A key element is the state representation of dynamical systems, also called the internal representation. Previously, dynamical systems were modeled by an external representation, also called an input-output relation. The internal representation introduces the very important concept of state of the system. The structure of these models is supposed to be known. Such models are nonlinear, but a linearization can be made. The question of internal representation from a given external representation is discussed. In the book it is claimed that an external representation can be always obtained from an internal representation.
Control theory has been already applied successfully in many fields, such as economics, management science and mathematical finance. The main purpose is to develop control theory for a very large family of systems. Stochastic control problems of linear dynamical systems with full and partial information as well as of non-Markov systems are also considered.
Nonlinear systems with non-quadratic payoffs are investigated. It is shown that for deterministic systems the Pontryagin’s maximum principle can be used to derive necessary conditions of optimality for an optimal control.
Problems of stochastic optimal control are considered as well. Applications of stochastic control algorithms to problems of financial mathematics are given. A financial market with \(n\) risky assets is considered. The price of assets is a random process. The Wiener process represents the only source of uncertainties in the financial market. Each component is an uncertainty, and the number of uncertainties is equal to the number of risky assets. These uncertainties are external and influence the evolution of the price of risky assets. The fact that the number of risky assets and the number of uncertainties are the same is a part of the assumption of complete markets. Stochastic control problems arising in this context are considered.
The consumer-investor problem is considered. The methods of dynamic programming and the martingale method are applied.
Many connections between estimation and control, as for example in the presentation of controllability and observability are discussed.
Classical estimation methods such that the maximum likelihood and the Bayesian approach are reviewed.

MSC:

37-02 Research exposition (monographs, survey articles) pertaining to dynamical systems and ergodic theory
37N35 Dynamical systems in control
37N40 Dynamical systems in optimization and economics
49N05 Linear optimal control problems
91A23 Differential games (aspects of game theory)
91G80 Financial applications of other theories
93C15 Control/observation systems governed by ordinary differential equations
93E10 Estimation and detection in stochastic control theory
93E11 Filtering in stochastic control theory
93E12 Identification in stochastic control theory
93E20 Optimal stochastic control
PDFBibTeX XMLCite
Full Text: DOI