×

Markov modulated Bernoulli process. (English) Zbl 0894.60064

Summary: We consider a Bernoulli process where the success probability changes with respect to a Markov chain. Such a model represents an interesting application of stochastic processes where the parameters are not constants; rather, they are stochastic processes themselves due to their dependence on a randomly changing environment. The model operates in a random environment depicted by a Markov chain so that the probability of success at each trial depends on the state of the environment. We will concentrate, in particular, on applications in reliability theory to motivate our model. The analysis will focus on transient as well as long-term behaviour of various processes involved.

MSC:

60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Çmlar E (1975) Introduction to stochastic processes. Prentice-Hall, New Jersey · Zbl 0341.60019
[2] Cmlar E, Özekici S (1987) Reliability of complex devices in random environments. Probability in the Engineering and Informational Sciences 1:97-115 · Zbl 1133.90321 · doi:10.1017/S0269964800000322
[3] Howard RA (1971) Dynamic probabilistic systems. Wiley, New York · Zbl 0227.90031
[4] Lefèvre C, Mihaud X (1990) On the association of the lifelengths of components subjected to a stochastic environment. Advances in Applied Probability 22:961-964 · Zbl 0718.60102 · doi:10.2307/1427571
[5] Özekici S (1996) Complex systems in random environments. In: Özekici S (Ed.) Reliability and maintenance of complex systems. Springer, Berlin
[6] Özekici S (1995) Optimal maintenance policies in random environments. European Journal of Operational Research 82:283-294 · Zbl 0905.90089 · doi:10.1016/0377-2217(94)00264-D
[7] Singpurwalla ND, Youngren MA (1993) Multivariate distributions induced by dynamic environments. Scandinavian Journal of Statistics 20:251-261 · Zbl 0817.62041
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.