Chen, Yanting; Bai, Xinwei; Boucherie, Richard J.; Goseling, Jasper Performance measures for the two-node queue with finite buffers. (English) Zbl 1483.60134 Probab. Eng. Inf. Sci. 34, No. 4, 522-549 (2020). MSC: 60K25 60G50 PDF BibTeX XML Cite \textit{Y. Chen} et al., Probab. Eng. Inf. Sci. 34, No. 4, 522--549 (2020; Zbl 1483.60134) Full Text: DOI arXiv OpenURL
Kern, Patrick; Simroth, Axel; Zähle, Henryk First-order sensitivity of the optimal value in a Markov decision model with respect to deviations in the transition probability function. (English) Zbl 1454.90105 Math. Methods Oper. Res. 92, No. 1, 165-197 (2020). MSC: 90C40 PDF BibTeX XML Cite \textit{P. Kern} et al., Math. Methods Oper. Res. 92, No. 1, 165--197 (2020; Zbl 1454.90105) Full Text: DOI arXiv OpenURL
Chen, Yanting; Boucherie, Richard J.; Goseling, Jasper Necessary conditions for the compensation approach for a random walk in the quarter-plane. (English) Zbl 1434.60182 Queueing Syst. 94, No. 3-4, 257-277 (2020). MSC: 60J10 60G50 PDF BibTeX XML Cite \textit{Y. Chen} et al., Queueing Syst. 94, No. 3--4, 257--277 (2020; Zbl 1434.60182) Full Text: DOI OpenURL
Li, Quan-Lin; Ma, Jing-Yu; Fan, Rui-Na; Xia, Li An overview for Markov decision processes in queues and networks. (English) Zbl 1473.90175 Li, Quan-Lin (ed.) et al., Stochastic models in reliability, network security and system safety. Essays dedicated to Professor Jinhua Cao on the occasion of his 80th birthday. Singapore: Springer. Commun. Comput. Inf. Sci. 1102, 44-71 (2019). Reviewer: Wiesław Kotarski (Sosnowiec) MSC: 90C40 90B22 90B10 90-02 PDF BibTeX XML Cite \textit{Q.-L. Li} et al., Commun. Comput. Inf. Sci. 1102, 44--71 (2019; Zbl 1473.90175) Full Text: DOI arXiv OpenURL
Chen, Yanting; Boucherie, Richard J.; Goseling, Jasper Invariant measures and error bounds for random walks in the quarter-plane based on sums of geometric terms. (English) Zbl 1348.60068 Queueing Syst. 84, No. 1-2, 21-48 (2016). MSC: 60G50 60J10 PDF BibTeX XML Cite \textit{Y. Chen} et al., Queueing Syst. 84, No. 1--2, 21--48 (2016; Zbl 1348.60068) Full Text: DOI arXiv OpenURL
Chen, Yanting; Boucherie, Richard J.; Goseling, Jasper The invariant measure of random walks in the quarter-plane: representation in geometric terms. (English) Zbl 1370.60086 Probab. Eng. Inf. Sci. 29, No. 2, 233-251 (2015). MSC: 60G50 60G57 PDF BibTeX XML Cite \textit{Y. Chen} et al., Probab. Eng. Inf. Sci. 29, No. 2, 233--251 (2015; Zbl 1370.60086) Full Text: DOI arXiv OpenURL
Boucherie, Richard J.; van Dijk, Nico M. Monotonicity and error bounds for networks of Erlang loss queues. (English) Zbl 1166.90325 Queueing Syst. 62, No. 1-2, 159-193 (2009). MSC: 90B22 60K25 PDF BibTeX XML Cite \textit{R. J. Boucherie} and \textit{N. M. van Dijk}, Queueing Syst. 62, No. 1--2, 159--193 (2009; Zbl 1166.90325) Full Text: DOI OpenURL
van Dijk, Nico M. Error bounds for state space truncation of finite Jackson networks. (English) Zbl 1138.90353 Eur. J. Oper. Res. 186, No. 1, 164-181 (2008). MSC: 90B15 90B22 90B18 PDF BibTeX XML Cite \textit{N. M. van Dijk}, Eur. J. Oper. Res. 186, No. 1, 164--181 (2008; Zbl 1138.90353) Full Text: DOI OpenURL
van Dijk, Nico M.; Sladký, Karel Monotonicity and comparison results for nonnegative dynamic systems. I: Discrete-time case. (English) Zbl 1249.60168 Kybernetika 42, No. 1, 37-56 (2006). MSC: 60J27 91B62 PDF BibTeX XML Cite \textit{N. M. van Dijk} and \textit{K. Sladký}, Kybernetika 42, No. 1, 37--56 (2006; Zbl 1249.60168) Full Text: EuDML Link OpenURL
Gordienko, Evgueni; Salem, Francisco Estimates of stability of Markov control processes with unbounded costs. (English) Zbl 1249.93176 Kybernetika 36, No. 2, 195-210 (2000). MSC: 93E20 93C55 PDF BibTeX XML Cite \textit{E. Gordienko} and \textit{F. Salem}, Kybernetika 36, No. 2, 195--210 (2000; Zbl 1249.93176) Full Text: EuDML Link OpenURL
Van Dijk, N. M.; Sladký, K. Error bounds for nonnegative dynamic models. (English) Zbl 0946.90106 J. Optimization Theory Appl. 101, No. 2, 449-474 (1999). MSC: 90C40 PDF BibTeX XML Cite \textit{N. M. Van Dijk} and \textit{K. Sladký}, J. Optim. Theory Appl. 101, No. 2, 449--474 (1999; Zbl 0946.90106) Full Text: DOI OpenURL
Gordienko, Evgueni I.; Salem, Francisco S. Robustness inequality for Markov control processes with unbounded costs. (English) Zbl 0902.93068 Syst. Control Lett. 33, No. 2, 125-130 (1998). MSC: 93E20 93C55 93B35 PDF BibTeX XML Cite \textit{E. I. Gordienko} and \textit{F. S. Salem}, Syst. Control Lett. 33, No. 2, 125--130 (1998; Zbl 0902.93068) Full Text: DOI OpenURL
van Dijk, Nico M. Error bounds for arbitrary approximations of “nearly reversible” Markov chains and a communications example. (English) Zbl 0914.60040 Kybernetika 33, No. 2, 171-184 (1997). Reviewer: K.Wickwire (Bedford) MSC: 60J20 PDF BibTeX XML Cite \textit{N. M. van Dijk}, Kybernetika 33, No. 2, 171--184 (1997; Zbl 0914.60040) Full Text: EuDML Link OpenURL
van Dijk, Nico M.; Miyazawa, Masakiyo Error bounds on a practical approximation for finite tandem queues. (English) Zbl 0892.90084 Oper. Res. Lett. 21, No. 4, 201-208 (1997). MSC: 90B22 60K25 PDF BibTeX XML Cite \textit{N. M. van Dijk} and \textit{M. Miyazawa}, Oper. Res. Lett. 21, No. 4, 201--208 (1997; Zbl 0892.90084) Full Text: DOI OpenURL
Burnetas, Apostolos N.; Katehakis, Michael N. On confidence intervals from simulation of finite Markov chains. (English) Zbl 0889.90153 Math. Methods Oper. Res. 46, No. 2, 241-250 (1997). MSC: 90C40 60J10 PDF BibTeX XML Cite \textit{A. N. Burnetas} and \textit{M. N. Katehakis}, Math. Methods Oper. Res. 46, No. 2, 241--250 (1997; Zbl 0889.90153) Full Text: DOI OpenURL
Gordienko, Evgueni; Montes-De-Oca, Raúl; Minjárez-Sosa, Adolfo Approximation of average cost optimal policies for general Markov decision processes with unbounded costs. (English) Zbl 0882.90127 Math. Methods Oper. Res. 45, No. 2, 245-263 (1997). MSC: 90C40 PDF BibTeX XML Cite \textit{E. Gordienko} et al., Math. Methods Oper. Res. 45, No. 2, 245--263 (1997; Zbl 0882.90127) Full Text: DOI OpenURL
van Dijk, Nico M. A note on time monotonicity for performability models. (English) Zbl 1095.60518 Probab. Eng. Inf. Sci. 10, No. 2, 299-310 (1996). MSC: 60K25 90B22 PDF BibTeX XML Cite \textit{N. M. van Dijk}, Probab. Eng. Inf. Sci. 10, No. 2, 299--310 (1996; Zbl 1095.60518) Full Text: DOI OpenURL
van Dijk, Nico M. Sensitivity error bounds for non-exponential stochastic networks. (English) Zbl 0860.90059 Kybernetika 31, No. 2, 175-188 (1995). MSC: 90B22 60K10 PDF BibTeX XML Cite \textit{N. M. van Dijk}, Kybernetika 31, No. 2, 175--188 (1995; Zbl 0860.90059) Full Text: EuDML Link OpenURL
Burnetas, Apostolos N.; Katehakis, Michael N. Computing optimal policies for Markovian decision processes using simulation. (English) Zbl 1336.90100 Probab. Eng. Inf. Sci. 9, No. 4, 525-537 (1995). MSC: 90C40 PDF BibTeX XML Cite \textit{A. N. Burnetas} and \textit{M. N. Katehakis}, Probab. Eng. Inf. Sci. 9, No. 4, 525--537 (1995; Zbl 1336.90100) Full Text: DOI OpenURL
Kovalenko, Igor N. Rare events in queueing systems – A survey. (English) Zbl 0804.90059 Queueing Syst. 16, No. 1-2, 1-49 (1994). MSC: 90B22 60K25 90B25 PDF BibTeX XML Cite \textit{I. N. Kovalenko}, Queueing Syst. 16, No. 1--2, 1--49 (1994; Zbl 0804.90059) Full Text: DOI OpenURL
Bielecki, Tomasz R.; Filar, Jerzy A. Singulary perturbed Markov control problem: Limiting average cost. (English) Zbl 0744.90096 Ann. Oper. Res. 28, No. 1-4, 153-168 (1991). Reviewer: E.A.Feinberg (Stony Brook) MSC: 90C40 60J10 PDF BibTeX XML Cite \textit{T. R. Bielecki} and \textit{J. A. Filar}, Ann. Oper. Res. 28, No. 1--4, 153--168 (1991; Zbl 0744.90096) Full Text: DOI OpenURL
Van Dijk, Nico M. On truncations and perturbations of Markov decision problems with an application to queueing network overflow control. (English) Zbl 0717.90096 Ann. Oper. Res. 29, No. 1-4, 515-535 (1991). MSC: 90C40 90B22 60K20 90-08 60J10 PDF BibTeX XML Cite \textit{N. M. Van Dijk}, Ann. Oper. Res. 29, No. 1--4, 515--535 (1991; Zbl 0717.90096) Full Text: DOI OpenURL