×

Discontinuous solutions of deterministic optimal stopping time problems. (English) Zbl 0629.49017

The deterministic optimal stopping time problem with continuous control as well consists of minimizing the cost \[ J(x,v,\vartheta,\psi)\equiv \int^{\vartheta}_{0}f(y_ x(s),v(s))e^{-\lambda s}ds+\psi (y_ x(\vartheta))e^{-\lambda \vartheta} \] over stopping times \(\vartheta\geq 0\) and controls \(V(\cdot)\in L^{\infty}({\mathbb{R}}^+;V)\) subject to the state y evolving according to \(dy_ x(s)+b(y_ x(s),v(s))ds=0\), \(y_ x(0)=x\in {\mathbb{R}}^ N\). The obstacle is \(\psi\) (\(\cdot)\) and the value function for a given obstacle is denoted \(u[\psi](x)=\inf_{\vartheta,v}J(x,v,\vartheta,\psi)\). When \(\psi\) is bounded and continuous, it is well known that u is characterized as the unique viscosity solution of the Bellman variational inequality \(\max \{H(x,u,Du),u-\psi \}=0\) in \({\mathbb{R}}^ N\) where \(H(x,t,p)=\sup \{b(x,v)\cdot p+\lambda t-f(x,v);v\in V\}\) The objective of this paper is to obtain a similar characterization for u if the obstacle is any arbitrary, possibly discontinuous, but bounded function. An application in which the obstacle is discontinuous is the problem of minimum exit time from a domain.
The study proceeds in this paper by using the upper and lower semicontinuous envelopes of the value function.
Reviewer: E.Barron

MSC:

49L20 Dynamic programming in optimal control and differential games
35F20 Nonlinear first-order PDEs
49J40 Variational inequalities
60G40 Stopping times; optimal stopping problems; gambling theory
35D05 Existence of generalized solutions of PDE (MSC2000)
49J45 Methods involving semicontinuity and convergence; relaxation
PDFBibTeX XMLCite
Full Text: DOI EuDML

References:

[1] I. CAPUZZO-DOLCETTA and H. ISHII, Approximate solutions of the Bellman Equations of deterministic control theory. Applied Math, andOpt. 11, (1984),pp. 161-181. Zbl0553.49024 MR743925 · Zbl 0553.49024
[2] I. CAPUZZO-DOLCETTA and P. L. LIONS, Hamilton-JacobiEquations and state- constraints problems ; In preparation. · Zbl 0825.49041
[3] M. G. CRANDALL, L. C. EVANS and P. L. LIONS, Some properties of viscosity solutions of Hamilton-Jacobi Equations ; Trans. Amer. Math. Soc., 282 (1984). Zbl0543.35011 MR732102 · Zbl 0543.35011
[4] M. G. CRANDALL, H. ISHII, and P. L. LIONS, Uniqueness of viscosity solutions revisited ; to appear. · Zbl 0644.35016
[5] M. G. CRANDALL and P. L. LIONS, Viscosity solutions of Hamilton-Jacobi Equations ; Trans. Amer. Math. Soc., 277 (1983). Zbl0599.35024 MR690039 · Zbl 0599.35024
[6] M. G. CRANDALL and P. L. LIONS, On existence and uniqueness of solutions of Hamilton-Jacobi Equations ; Non Linear Anal. TMA. Vol. 10, N^\circ 6 (1986). Zbl0603.35016 MR836671 · Zbl 0603.35016
[7] W. H. FLEMING and R. W. RISHEL, Deterministic and stochastic optimal control. Springer, Berlin 1975. Zbl0323.49001 MR454768 · Zbl 0323.49001
[8] H. ISHII, Hamilton-Jacobi Equations with discontinuous Hamiltonians on arbitrary open subsets. Zbl0937.35505 · Zbl 0937.35505
[9] H. ISHII, Perron’s method for Hamilton-Jacobi Equations ; to appear. Zbl0697.35030 · Zbl 0697.35030
[10] E. B. LEE and L. MARKUS, Foundations of optimal control theory, J. Wiley, New York (1967). Zbl0159.13201 MR220537 · Zbl 0159.13201
[11] P. L. LIONS, Generalized solutions of Hamilton-Jacobi Equations. Pitman, 1982. Zbl0497.35001 MR667669 · Zbl 0497.35001
[12] P. L. LIONS and B. PERTHAME, Remarks on Hamilton-Jacobi Equations with discontinuous time-dependent coefficients ; Non Linear Anal. TMA. Vol. 11, n^\circ 7 (1987). Zbl0688.35052 MR886652 · Zbl 0688.35052
[13] P. L. LIONS and P. E. SOUGANIDIS, Differential games, optimal control and directional derivatives of viscosity solutions of Bellman’s and Isaac’s Equations ; SIAM J. Control and Optimization, vol. 23, n^\circ 4 (1985). Zbl0569.49019 MR791888 · Zbl 0569.49019
[14] J. P. QUADRAT, in Thèse d’Etat, Univ. Paris IX-Dauphine.
[15] M. H. SONER, Optimal controlproblems with state-space constraints. SIAM J.on Control and Optimisation. Vol. 24, n^\circ 3, pp. 551-561 and Vol. 24, n^\circ 4, pp. 1110-1122. Zbl0619.49013 MR861089 · Zbl 0619.49013
[16] J. WARGA, Optimal control of differential and functionnal equations. Academic press, (1972). Zbl0253.49001 MR372708 · Zbl 0253.49001
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.