# zbMATH — the first resource for mathematics

##### Examples
 Geometry Search for the term Geometry in any field. Queries are case-independent. Funct* Wildcard queries are specified by * (e.g. functions, functorial, etc.). Otherwise the search is exact. "Topological group" Phrases (multi-words) should be set in "straight quotation marks". au: Bourbaki & ti: Algebra Search for author and title. The and-operator & is default and can be omitted. Chebyshev | Tschebyscheff The or-operator | allows to search for Chebyshev or Tschebyscheff. "Quasi* map*" py: 1989 The resulting documents have publication year 1989. so: Eur* J* Mat* Soc* cc: 14 Search for publications in a particular source with a Mathematics Subject Classification code (cc) in 14. "Partial diff* eq*" ! elliptic The not-operator ! eliminates all results containing the word elliptic. dt: b & au: Hilbert The document type is set to books; alternatively: j for journal articles, a for book articles. py: 2000-2015 cc: (94A | 11T) Number ranges are accepted. Terms can be grouped within (parentheses). la: chinese Find documents in a given language. ISO 639-1 language codes can also be used.

##### Operators
 a & b logic and a | b logic or !ab logic not abc* right wildcard "ab c" phrase (ab c) parentheses
##### Fields
 any anywhere an internal document identifier au author, editor ai internal author identifier ti title la language so source ab review, abstract py publication year rv reviewer cc MSC code ut uncontrolled term dt document type (j: journal article; b: book; a: book article)
Taylor series expansions for stationary Markov chains. (English) Zbl 1043.60056
From the authors’ abstract: We study Taylor series expansions of stationary characteristics of general-state-space Markov chains. The elements of the Taylor series are explicitly calculated and a lower bound for the radius of convergence of the Taylor series is established.

##### MSC:
 60J10 Markov chains (discrete-time Markov processes on discrete state spaces) 90C31 Sensitivity, stability, parametric optimization
UMDES
Full Text:
##### References:
 [1] Ayhan, H. and Baccelli, F. (2001). Expansions for joint Laplace transforms of stationary waiting times in (max,$+$)-linear systems with Poisson input. Queueing Systems 37 , 291--328. · Zbl 0972.60093 · doi:10.1023/A:1011008704491 [2] Ayhan, H. and Seo, D. (2001). Laplace transform and moments of waiting times in Poisson driven (max,$+$)-linear systems. Queueing Systems 37 , 405--436. · Zbl 1017.90013 · doi:10.1023/A:1010845618420 [3] Ayhan, H. and Seo, D. (2002). Tail probability of transient and stationary waiting times in (max,$+$)-linear systems. IEEE Trans. Automatic Control 47 , 151--157. · doi:10.1109/9.981736 [4] Baccelli, F. and Schmidt, V. (1996). Taylor series expansions for Poisson-driven (max,$+$)-linear systems. Ann. Appl. Prob. 6 , 138--185. · Zbl 0863.60092 · doi:10.1214/aoap/1034968069 [5] Baccelli, F., Hasenfuss, S. and Schmidt, V. (1997). Transient and stationary waiting times in (max,$+$)-linear systems with Poisson input. Queueing Systems 26 , 301--342. · Zbl 0892.90070 · doi:10.1023/A:1019141510202 [6] Baccelli, F., Hasenfuss, S. and Schmidt, V. (1998). Expansions for steady-state characteristics of (max,$+$)-linear systems. Commun. Statist. Stoch. Models 14 , 1--24. · Zbl 0929.60074 · doi:10.1080/15326349808807458 [7] Borovkov, A. and Hordijk, A. (2004). Characterization and sufficient conditions for normed ergodicity of Markov chains. To appear in Adv. Appl. Prob. 36 , No. 1. · Zbl 1053.60078 · doi:10.1239/aap/1077134471 [8] Cao, X.-R. (1998). The Maclaurin series for performance functions of Markov chains. Adv. Appl. Prob. 30 , 676--692. · Zbl 0916.60063 · doi:10.1239/aap/1035228123 [9] Cassandras, C. and Lafortune, S. (1999). Introduction to Discrete Event Systems . Kluwer, Norwell, MA. · Zbl 0934.93001 · doi:10.1023/A:1008323906342 [10] Coolen-Schrijner, P. and van Doorn, E. A. (2002). The deviation matrix of a continuous-time Markov chain. Prob. Eng. Inf. Sci. 16 , 351--366. · Zbl 1011.60057 · doi:10.1017/S0269964802163066 [11] Dekker, R. and Hordijk, A. (1988). Average, sensitive and Blackwell optimal policies in denumerable Markov decision chains with unbounded rewards. Math. Operat. Res. 13 , 395--421. · Zbl 0652.90099 · doi:10.1287/moor.13.3.395 [12] Dekker, R., Hordijk, A. and Spieksma, F. M. (1994). On the relation between recurrence and ergodicity properties in denumerable Markov decision chains. Math. Operat. Res. 19 , 539--559. · Zbl 0843.90127 · doi:10.1287/moor.19.3.539 [13] Gong, W.-B. and Hu, J.-Q. (1992). The Maclaurin series of the GI/G/1 queue. J. Appl. Prob. 29 , 176--184. · Zbl 0765.60097 · doi:10.2307/3214801 [14] Heidergott, B. and Vázquez-Abad, F. (2000). Measure-valued differentiation for stochastic processes: the finite horizon case. EURANDOM Report 2000-033. Available at http://staff.feweb.vu.nl/bheidergott/. [15] Heidergott, B., Hordijk, A. and Weisshaupt, H. (2002). Derivatives of Markov kernels and their Jordan decomposition. EURANDOM Report 2003-001. Available at http://staff.feweb.vu.nl/bheidergott/. · Zbl 1159.60027 · doi:10.1515/JAA.2008.13 · http://www.heldermann.de/JAA/JAA14/JAA141/jaa14002.htm [16] Heidergott, B., Hordijk, A. and Weisshaupt, H. (2002). Measure-valued differentiation for stationary Markov chains. EURANDOM Report 2002-027. Available at http://staff.feweb.vu.nl/bheidergott/. · Zbl 1278.90428 [17] Ho, Y. and Cao, X. (1991). Perturbation Analysis of Discrete Event Systems . Kluwer, Boston, MA. · Zbl 0744.90036 [18] Hordijk, A. and Dekker, R. (1983). Average, sensitive and Blackwell optimal policies in denumerable Markov decision chains with unbounded rewards. Rep. 83--36, Institute of Applied Mathematics and Computing Science, Leiden University. · Zbl 0652.90099 · doi:10.1287/moor.13.3.395 [19] Hordijk, A. and Puterman, M. L. (1987). On the convergence of policy iteration in finite state undiscounted Markov decision processes: the unichain case. Math. Operat. Res. 12 , 163--176. · Zbl 0627.90095 · doi:10.1287/moor.12.1.163 [20] Hordijk, A. and Spieksma, F. M. (1992). On ergodicity and recurrence properties of a Markov chain with an application to an open Jackson network. Adv. Appl. Prob. 24 , 343--376. · Zbl 0766.60085 · doi:10.2307/1427696 [21] Hu, J.-Q. (1995). Analyticity of single-server queues in light traffic. Queueing Systems 19 , 63--80. · Zbl 0820.60075 · doi:10.1007/BF01148940 [22] Hu, J.-Q. (1996). The departure process of the GI/G/1 queue and its Maclaurin series. Operat. Res. 44 , 810--815. · Zbl 0879.60103 · doi:10.1287/opre.44.5.810 [23] Kartoschov, N. (1985). Inequalities in theorems of ergodicity and stability for Markov chains with common phase space. Theory Prob. Appl. 30 , 247--259. · Zbl 0657.60088 · doi:10.1137/1130034 [24] Koole, G. M. (1998). The deviation matrix of the M/M/1/$\infty$ and M/M/1/$N$ queue, with applications to controlled queueing models. In Proc. 37th IEEE Conf. Decision Control (Tampa, FL), IEEE Press, pp. 56--59. [25] Koole, G. M. and Spieksma, F. M. (2001). On deviation matrices for birth--death process. Prob. Eng. Inf. Sci. 15 , 239--258. · Zbl 0998.60084 · doi:10.1017/S0269964801152071 [26] Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability . Springer, London. · Zbl 0925.60001 [27] Pflug, G. (1996). Optimisation of Stochastic Models . Kluwer, Boston, MA. · Zbl 0857.93103 [28] Van den Hout, W. (1996). The power-series-algorithm . Doctoral Thesis, Center for Economic Research, Tilburg University. [29] Zhu, Y. and Li, H. (1993). The Maclaurin expansion for a G/GI/1 queue with Markov-modulated arrivals and services. Queueing Systems 14 , 125--134. · Zbl 0780.60098 · doi:10.1007/BF01153530 [30] Zazanis, M. (1992). Analyticity of Poisson-driven stochastic systems. Adv. Appl. Prob. 24 , 532--541. · Zbl 0757.60045 · doi:10.2307/1427478