×

Sequential Monte Carlo sampling in hidden Markov models of nonlinear dynamical systems. (English) Zbl 1334.65011

Summary: We investigate the issue of which state functionals can have their uncertainty estimated efficiently in dynamical systems with uncertainty. Because of the high dimensionality and complexity of the problem, sequential Monte Carlo (SMC) methods are used. We investigate SMC methods where the proposal distribution is computed by maximum likelihood or by a linearization approach. We prove that the variance of the SMC method is bounded linearly in the number of time steps when the proposal distribution is truncated normal distribution. We also show that for a moderate large number of steps the error produced by approximation of dynamical systems linearly accumulates on the condition that the logarithm of the density function of noise is Lipschitz continuous. This finding is significant because the uncertainty in many dynamical systems, in particular, in chemical engineering systems, can be assumed to have this nature. We demonstrate our findings for a simple test case from chemical engineering. The theoretical findings provide a foundation for the parallel software SISTOS.

MSC:

65C05 Monte Carlo methods
65C40 Numerical analysis or methods applied to Markov chains
62D05 Sampling theory, sample surveys
62M05 Markov processes: estimation; hidden Markov models

Software:

CVODES; TAO; ADIC; PETSc; SISTOS; ADOL-C
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Bebbington, W., Reprocessing of nuclear fuels, Sci. Am., 235, 30-41 (1976)
[2] Uchiyama, G.; Fujine, S.; Hotoku, S.; Maeda, M., New separation process for neptunium, plutonium, and uranium using butyraldehydes as reductants in reprocessing, Nucl. Technol., 102, 341-352 (1993)
[3] Crowley, K., Nuclear waste disposal: the technical challenges, Phys. Today, 50, 32-40 (1997)
[4] Birkett, J.; Carrott, M.; Fox, O.; Jones, C.; Maher, C.; Roube, C.; Taylor, R.; Woodhead, D., Recent developments in the Purex process for nuclear fuel reprocessing: complexant based stripping for uranium/plutonium separation, CHIMIA Int. J. Chem., 59, 898-904 (2005)
[5] Rabiner, L.; Juang, B., An introduction to hidden Markov models, IEEE ASSp Mag., 3, 4-16 (1986)
[6] Welch, G.; Bishop, G., An Introduction to the Kalman Filter (1995), University of North Carolina at Chapel Hill: University of North Carolina at Chapel Hill Chapel Hill, NC
[7] Houtekamer, P.; Mitchell, H., Data assimilation using an ensemble Kalman filter technique, Mon. Weather Rev., 126, 796-811 (1998)
[8] Houtekamer, P.; Mitchell, H., A sequential ensemble Kalman filter for atmospheric data assimilation, Mon. Weather Rev., 129, 123-137 (2001)
[9] Wan, E.; Van Der Merwe, R., The unscented Kalman filter for nonlinear estimation, (Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000 (AS-SPCC) (2000), IEEE), 153-158
[10] Kalnay, E., Atmospheric Modeling, Aata Assimilation, and Predictability (2003), Cambridge Univ. Press
[11] Mamon, R.; Elliott, R., Hidden Markov Models in Finance (2007), Springer Verlag · Zbl 1116.91007
[13] Rabiner, L., A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE, 77, 257-286 (1989)
[14] Schliep, A.; Schonhuth, A.; Steinhoff, C., Using hidden Markov models to analyze gene expression time course data, Bioinformatics, 19, i255-i263 (2003)
[15] Hammersley, J.; Morton, K., Poor man’s Monte Carlo, J. R. Stat. Soc. Ser. B (Methodological), 16, 23-38 (1954) · Zbl 0055.36901
[16] Rosenbluth, M.; Rosenbluth, A., Monte Carlo calculation of the average extension of molecular chains, J. Chem. Phys., 23, 356-359 (1955)
[17] Akashi, H.; Kumamoto, H., Construction of discrete-time nonlinear filter by Monte Carlo methods with variance-reducing techniques, Syst. Control, 19, 211-221 (1975)
[18] Evensen, G., Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics, J. Geophys. Res., 99, 10143 (1994)
[19] Kremer, K.; Binder, K., Monte Carlo simulation of lattice models for macromolecules, Comput. Phys. Rep., 7, 259-310 (1988)
[20] Evans, M.; Swartz, T., Methods for approximating integrals in statistics with special emphasis on Bayesian integration problems, Stat. Sci., 10, 254-272 (1995) · Zbl 0955.62553
[21] Liu, J. S., Monte Carlo Strategies in Scientific Computing (2008), Springer · Zbl 1132.65003
[24] Chopin, N., Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference, Ann. Stat., 32, 2385-2411 (2004) · Zbl 1079.65006
[25] Del Moral, P., Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications (2004), Springer Verlag · Zbl 1130.60003
[26] Kunsch, H., Recursive Monte Carlo filters: algorithms and theoretical analysis, Ann. Stat., 33, 1983-2021 (2005) · Zbl 1086.62106
[28] Dobrushing, R., Central limit theorem for non-stationary markov chains i, ii, Theory Probab. Appl., 1, 65-80, 329-383 (1956)
[29] Zeng, X.; Anitescu, M.; Pereira, C.; Regalbuto, M., A Framework for chemical plant safety assessment under uncertainty, Stud. Inf. Control, 18, 7-20 (2009)
[30] Singh, C.; Saraf, D., Simulation of side-fired steam-hydrocarbon reformers, Ind. Eng. Chem. Process Des. Dev., 18, 1-7 (1979)
[32] Bischof, C.; Roh, L.; Mauer-Oats, A., ADIC: an extensible automatic differentiation tool for ANSI-C, Urbana, 51, 61802 (1997)
[33] Griewank, A.; Juedes, D.; Srinivasan, J., ADOL-C, a package for the automatic differentiation of algorithms written in C/C++, ACM Trans. Math. Softw., 22 (1996) · Zbl 0884.65015
[35] Carlin, B.; Louis, T., Bayes and empirical Bayes methods for data analysis, Stat. Comput., 7, 153-154 (1997)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.