Stochastic models. An algorithmic approach. (English) Zbl 0838.60075

Chichester: Wiley & Sons. x, 375 p. (1994).
The main notions and results of the theory of renewal processes, Markov chains, Markov decision processes and queueing theory are stated. The material is thoroughly selected, so that on the one hand it is intelligible to students, which know basic course of probability theory well enough, and on the other hand it can be used for non-trivial analysis of substantial problems arising in inventory control, actuarial mathematics, operations research, teletraffic theory. Detailed analysis of a large number of realistic problems is an important merit of the book. I think that the book will be very useful both for students and for professionals who wish to become proficient in modern methods of stochastic modelling.
Reviewer: G.Falin (Moskva)


60K25 Queueing theory (aspects of probability theory)
60-02 Research exposition (monographs, survey articles) pertaining to probability theory
90B22 Queues and service in operations research
90B05 Inventory, storage, reservoirs
90C40 Markov and semi-Markov decision processes
90-02 Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming