Randomization procedures in the computation of cumulative-time distributions over discrete state Markov processes. (English) Zbl 0546.90038

Summary: This paper proposes a methodology for computing numerical bounds on cumulative-time (i.e. the time spent in a specified set of states before entering another specified set of states) distributions over discrete state Markov processes. The methodology uses randomization procedures to compute results for appropriately defined transient Markov processes; the transient distribution computed is equivalent to the requisite cumulative-time distribution. A queueing application of the methodology to delay times in queueing networks is outlined and its efficacy is appraised by comparing the results with a sojourn time for a problem with a known distribution.


90B22 Queues and service in operations research
60J05 Discrete-time Markov processes on general state spaces
60K20 Applications of Markov renewal processes (reliability, queueing networks, etc.)
65C99 Probabilistic methods, stochastic differential equations
Full Text: DOI