Tijms, Henk C. Stochastic models. An algorithmic approach. (English) Zbl 0838.60075 Chichester: Wiley & Sons. x, 375 p. (1994). The main notions and results of the theory of renewal processes, Markov chains, Markov decision processes and queueing theory are stated. The material is thoroughly selected, so that on the one hand it is intelligible to students, which know basic course of probability theory well enough, and on the other hand it can be used for non-trivial analysis of substantial problems arising in inventory control, actuarial mathematics, operations research, teletraffic theory. Detailed analysis of a large number of realistic problems is an important merit of the book. I think that the book will be very useful both for students and for professionals who wish to become proficient in modern methods of stochastic modelling. Reviewer: G.Falin (Moskva) Cited in 244 Documents MSC: 60K25 Queueing theory (aspects of probability theory) 60-02 Research exposition (monographs, survey articles) pertaining to probability theory 90B22 Queues and service in operations research 90B05 Inventory, storage, reservoirs 90C40 Markov and semi-Markov decision processes 90-02 Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming Keywords:renewal processes; Markov chains; Markov decision processes; queueing theory PDFBibTeX XMLCite \textit{H. C. Tijms}, Stochastic models. An algorithmic approach. Chichester: Wiley \& Sons (1994; Zbl 0838.60075)