×

Ensemble filter methods with perturbed observations applied to nonlinear problems. (English) Zbl 1425.65015

Summary: The ensemble Kalman filter (EnKF) has been shown repeatedly to be an effective method for data assimilation in large-scale problems, including those in petroleum engineering. Data assimilation for multiphase flow in porous media is particularly difficult, however, because the relationships between model variables (e.g., permeability and porosity) and observations (e.g., water cut and gas-oil ratio) are highly nonlinear. Because of the linear approximation in the update step and the use of a limited number of realizations in an ensemble, the EnKF has a tendency to systematically underestimate the variance of the model variables. Various approaches have been suggested to reduce the magnitude of this problem, including the application of ensemble filter methods that do not require perturbations to the observed data. On the other hand, iterative least-squares data assimilation methods with perturbations of the observations have been shown to be fairly robust to nonlinearity in the data relationship. In this paper, we present EnKF with perturbed observations as a square root filter in an enlarged state space. By imposing second-order-exact sampling of the observation errors and independence constraints to eliminate the cross-covariance with predicted observation perturbations, we show that it is possible in linear problems to obtain results from EnKF with observation perturbations that are equivalent to ensemble square-root filter results. Results from a standard EnKF, EnKF with second-order-exact sampling of measurement errors that satisfy independence constraints (EnKF (SIC)), and an ensemble square-root filter (ETKF) are compared on various test problems with varying degrees of nonlinearity and dimensions. The first test problem is a simple one-variable quadratic model in which the nonlinearity of the observation operator is varied over a wide range by adjusting the magnitude of the coefficient of the quadratic term. The second problem has increased observation and model dimensions to test the EnKF (SIC) algorithm. The third test problem is a two-dimensional, two-phase reservoir flow problem in which permeability and porosity of every grid cell (5,000 model parameters) are unknown. The EnKF (SIC) and the mean-preserving ETKF (SRF) give similar results when applied to linear problems, and both are better than the standard EnKF. Although the ensemble methods are expected to handle the forecast step well in nonlinear problems, the estimates of the mean and the variance from the analysis step for all variants of ensemble filters are also surprisingly good, with little difference between ensemble methods when applied to nonlinear problems.

MSC:

65C20 Probabilistic models, generic numerical methods in probability and statistics
76M35 Stochastic analysis applied to problems in fluid mechanics
76S05 Flows in porous media; filtration; seepage

Software:

EnKF
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Anderson, J.L.: An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 129(12), 2884–2903 (2001)
[2] Anderson, J.L., Wyman, B., Zhang, S., Hoar, T.: Assimilation of surface pressure observations using an ensemble filter in an idealized global atmospheric prediction system. J. Atmos. Sci. 62(8), 2925–2938 (2005)
[3] Bates, D.M., Watts, D.G.: Relative curvature measures of nonlinearity. J. R. Stat. Soc. B 42(1), 1–25 (1980) · Zbl 0455.62028
[4] Bengtsson, T., Snyder, C., Nychka, D.: Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res.–Atmospheres 108(D24), ARTN 8775 (2003)
[5] Bertino, L., Evensen, G., Wackernagel, H.: Sequential data assimilation techniques in oceanography. Int. Stat. Rev. 71(2), 223–241 (2003) · Zbl 1114.62364
[6] Bishop, C.H., Etherton, B.J., Majumdar, S.J.: Adaptive sampling with the ensemble transform Kalman filter. Part I: theoretical aspects. Mon. Weather Rev. 129(3), 420–436 (2001)
[7] Burgers, G., van Leeuwen, P., Evensen, G.: Analysis scheme in the ensemble Kalman filter. Mon. Weather Rev. 126(6), 1719–1724 (1998)
[8] Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 99(C5), 10143–10162 (1994)
[9] Evensen, G.: Sampling strategies and square root analysis schemes for the EnKF. Ocean Dyn. 54(6), 539–560 (2004)
[10] Furrer, R., Bengtsson, T.: Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants. J. Multivar. Anal. 98(2), 227–255 (2007) · Zbl 1105.62091
[11] Grimstad, A.-A., Mannseth, T.: Nonlinearity, scale, and sensitivity for parameter estimation problems. SIAM J. Sci. Comput. 21(6), 2096–2113 (2000) · Zbl 0952.35153
[12] Houtekamer, P.L., Mitchell, H.L.: Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev. 126(3), 796–811 (1998)
[13] Houtekamer, P.L., Mitchell, H.L., Pellerin, G., Buehner, M., Charron, M., Spacek, L., Hansen, B.: Atmospheric data assimilation with an ensemble Kalman filter: Results with real observations. Mon. Weather Rev. 133(3), 604–620 (2005)
[14] Kepert, J.: Issues in the design and implementation of an ensemble Kalman filter. http://meteo9.uibk.ac.at/ehrendorfer/adjoint_workshop/pdffiles/Kepert_Adj_2004.pdf (2004)
[15] Kitanidis, P.K.: Quasi-linear geostatistical theory for inversing. Water Resour. Res. 31(10), 2411–2419 (1995)
[16] Leeuwenburgh, O., Evensen, G., Bertino, L.: The impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific. Q. J. R. Meteorol. Soc. 131(613), 3291–3300 (2005)
[17] Liu, N., Oliver, D.S.: Evaluation of Monte Carlo methods for assessing uncertainty. SPE J. 8(2), 188–195 (2003)
[18] Liu, N., Oliver, D.S.: Experimental assessment of gradual deformation method. Math. Geol. 36(1), 65–77 (2004) · Zbl 1042.86522
[19] Mezzadri, F.: How to generate random matrices from the classical compact groups. Not. Am. Math. Soc. 54(5), 592–604 (2007) · Zbl 1156.22004
[20] Oliver, D.S., He, N., Reynolds, A.C.: Conditioning permeability fields to pressure data. In: European Conference for the Mathematics of Oil Recovery, V, pp. 1–11 (1996)
[21] Pham, D.T.: Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Weather Rev. 129(5), 1194–1207 (2001)
[22] Sakov, P., Oke, P.R.: A deterministic formulation of the ensemble Kalman filter: an alternative to ensemble square root filters. Tellus A 60(2), 361–371 (2008a)
[23] Sakov P., Oke, P.R.: Implications of the form of the ensemble transformation in the ensemble square root filters. Mon. Weather Rev. 136(3), 1042–1053 (2008b)
[24] Tarantola, A.: Inverse Problem Theory: Methods for Data Fitting and Model Parameter Estimation. Elsevier, Amsterdam (1987) · Zbl 0875.65001
[25] Tippett, M.K., Anderson, J.L., Bishop, C.H., Hamill, T.M., Whitaker, J.S.: Ensemble square-root filters. Mon. Weather Rev. 131, 1485–1490 (2003)
[26] Verlaan, M., Heemink, A.W.: Nonlinearity in data assimilation applications: A practical method for analysis. Mon. Weather Rev. 129(6), 1578–1589 (2001)
[27] Wang, X., Bishop, C.H., Julier, S.J.: Which is better, an ensemble of positive-negative pairs or a centered spherical simplex ensemble? Mon. Weather Rev. 132(7), 1590–1605 (2004)
[28] Wei, M., Toth, Z., Wobus, R., Zhu, Y., Bishop, C.H., Wang, X.: Ensemble transform Kalman filter-based ensemble perturbations in an operational global prediction system at NCEP. Tellus A 58, 28–44 (2006)
[29] Whitaker, J.S., Hamill, T.M.: Ensemble data assimilation without perturbed observations. Mon. Weather Rev. 130(7), 1913–1924 (2002)
[30] Zang, X., Malanotte-Rizzoli, P.: A comparison of assimilation results from the ensemble Kalman filter and a reduced-rank extended Kalman filter. Nonlinear Process. Geophys. 10(6), 477–491 (2003)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.