##
**Control of spatially structured random processes and random fields with applications.**
*(English)*
Zbl 1170.93002

Nonconvex Optimization and Its Applications 86. New York, NY: Springer (ISBN 0-387-30409-6/hbk). xiii, 261 p. (2006).

Publisher’s description: This book is devoted to the study and optimization of spatiotemporal stochastic processes, that is, processes which develop simultaneously in space and time under random influences. These processes are seen to occur almost everywhere when studying the global behavior of complex systems, including: Physical and technical systems; Population dynamics; Neural networks; Computer and telecommunication networks; Complex production networks; Flexible manufacturing systems; Logistic networks and transportation systems; Environmental engineering; Climate modelling and prediction; Earth surface models.

Classical stochastic dynamic optimization forms the framework of the book. Taken as a whole, the project undertaken in the book is to establish optimality or near-optimality for Markovian policies in the control of spatiotemporal Markovian processes. The authors apply this general principle to different frameworks of Markovian systems and processes. Depending on the structure of the systems and the surroundings of the model classes the authors arrive at different levels of simplicity for the policy classes which encompass optimal or nearly optimal policies. A set of examples accompanies the theoretical findings, and these examples should demonstrate some important application areas for the theorems discussed.

Classical stochastic dynamic optimization forms the framework of the book. Taken as a whole, the project undertaken in the book is to establish optimality or near-optimality for Markovian policies in the control of spatiotemporal Markovian processes. The authors apply this general principle to different frameworks of Markovian systems and processes. Depending on the structure of the systems and the surroundings of the model classes the authors arrive at different levels of simplicity for the policy classes which encompass optimal or nearly optimal policies. A set of examples accompanies the theoretical findings, and these examples should demonstrate some important application areas for the theorems discussed.

### MSC:

93-02 | Research exposition (monographs, survey articles) pertaining to systems and control theory |

93E03 | Stochastic systems in control theory (general) |

60G60 | Random fields |

60K15 | Markov renewal processes, semi-Markov processes |

60K35 | Interacting random processes; statistical mechanics type models; percolation theory |

90B15 | Stochastic network models in operations research |

90C40 | Markov and semi-Markov decision processes |

91A15 | Stochastic games, stochastic differential games |