an:05602489
Zbl 1176.60062
Gordienko, Evgueni; Lemus-Rodr??guez, Enrique; Montes-de-Oca, Ra??l
Average cost Markov control processes: Stability with respect to the Kantorovich metric
EN
Math. Methods Oper. Res. 70, No. 1, 13-33 (2009).
00252813
2009
j
60J05 93E10 90C40 93D99
discrete-time Markov control process; average cost; contraction; stability inequality; Kantorovich metric
Perturbations of a discrete-time Markov control process are studied on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. It is assumed that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions, the authors find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the inequalities found, the approximation by relevant empirical distributions are considered. The results are illustrated by estimating the stability of a simple autoregressive control process. Some examples of unstable processes are also provided.
Pavel Gapeev (London)