On the variance in controlled Markov chains. (English) Zbl 0215.25902


60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
Full Text: EuDML


[1] R. Bellman: Dynamic programming. Princeton 1957. · Zbl 0995.90618
[2] R. A. Howard: Dynamic programming and Markov processes. New York, London 1960. · Zbl 0091.16001
[3] J. G. Kemeny J. L. Snell: Finite Markov chains. Princeton 1960. · Zbl 0089.13704
[4] P. Mandl: Controlled Markov chains. (in Czech). Kybernetika 6 (1969), Supplement, 1 - 74.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.