×

zbMATH — the first resource for mathematics

On a gambler’s ruin problem. (English) Zbl 0965.60043
A particle moves in independent steps on the real line. Its initial position is 0. The \(u\)th step is described by a random variable \(X_u\) such that \(X_u=1\) w.p. \(p\), \(X_u=-1\) w.p. \(q\), and \(X_u=0\) w.p. \(r\), where \(p+q+r=1\). Let \(a\) and \(b\) be positive integers. Consider barriers at points \(-b\) and \(a\). If the particle reaches \(-b\), it is immediately returned to the given point \(j\), \(-b<j<a\). The barrier \(a\) is absorbing. The authors give an explicit result for the absorption probabilities. The derivation is based on a generating function.

MSC:
60G40 Stopping times; optimal stopping problems; gambling theory
60G50 Sums of independent random variables; random walks
60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
PDF BibTeX XML Cite
Full Text: EuDML
References:
[1] BARNETT V. D.: A three-player extension of the gambler’s ruin problem. J. Appl. Probab. 1 (1964), 321-334. · Zbl 0192.25501
[2] BLASI A.: On a random walk between a reflecting and an absorbing barrier. Ann. Probab. 4 (1976), 695-696. · Zbl 0342.60050
[3] COX D. R.-MILLER H. D.: The Theory of Stochastic Processes. Methuen, London, 1965. · Zbl 0149.12902
[4] EL-SHEHAWY M. A.: On absorption probabilities for a random walk between two different barriers. Ann. Fac. Sci. Toulouse Math. (5) I (1992), 95-103. · Zbl 0765.60071
[5] FELLER W.: An Introduction to Probability Theory and Its Applications. Vol. 1. (3rd, Wiley, New York, 1968. · Zbl 0155.23101
[6] GULATI C. M.-HILL J. M.: A note on an alternative derivation of random walk probabilities. Sankhya Ser. A 43 (1981), 379-383. · Zbl 0522.60075
[7] KANNAN D.: An Introduction to Stochastic Processes. New York, 1979. · Zbl 0418.60002
[8] MUNFORD A. G.: A first passage problem in a random walk with a quality control application. J. Roy. Statist. Soc. Ser. B 43 (1981), 142-146. · Zbl 0477.60082
[9] SRINIVASAN S. K.-MEHATA K. M.: Stochastic Processes. McGraw Hill, New Delhi, 1976.
[10] WEESAKUL B.: The random walk between a reflecting and an absorbing barrier. Ann. Math. Statist. 32 (1961), 765-769. · Zbl 0109.10903
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.