A deep-learning-based geological parameterization for history matching complex models.

*(English)*Zbl 1421.86004
Math. Geosci. 51, No. 6, 725-766 (2019); correction ibid. 51, No. 6, 841-842 (2019).

Summary: A new low-dimensional parameterization based on principal component analysis (PCA) and convolutional neural networks (CNN) is developed to represent complex geological models. The CNN-PCA method is inspired by recent developments in computer vision using deep learning. CNN-PCA can be viewed as a generalization of an existing optimization-based PCA (O-PCA) method. Both CNN-PCA and O-PCA entail post-processing a PCA model to better honor complex geological features. In CNN-PCA, rather than use a histogram-based regularization as in O-PCA, a new regularization involving a set of metrics for multipoint statistics is introduced. The metrics are based on summary statistics of the nonlinear filter responses of geological models to a pre-trained deep CNN. In addition, in the CNN-PCA formulation presented here, a convolutional neural network is trained as an explicit transform function that can post-process PCA models quickly. CNN-PCA is shown to provide both unconditional and conditional realizations
that honor the geological features present in reference SGeMS geostatistical realizations for a binary channelized system. Flow statistics obtained through simulation of random CNN-PCA models closely match results for random SGeMS models for a demanding case in which O-PCA models lead to significant discrepancies. Results for history matching are also presented. In this assessment CNN-PCA is applied with derivative-free optimization, and a subspace randomized maximum likelihood method is used to provide multiple posterior models. Data assimilation and significant uncertainty reduction are achieved for existing wells, and physically reasonable predictions are also obtained for new wells. Finally, the CNN-PCA method is extended to a more complex nonstationary bimodal deltaic fan system, and is shown to provide high-quality realizations for this challenging example.

##### MSC:

86A04 | General questions in geophysics |

86A22 | Inverse problems in geophysics |

68T05 | Learning and adaptive systems in artificial intelligence |

PDF
BibTeX
XML
Cite

\textit{Y. Liu} et al., Math. Geosci. 51, No. 6, 725--766 (2019; Zbl 1421.86004)

Full Text:
DOI

##### References:

[1] | Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. Paper presented at the 34th international conference on machine learning, Sydney, Australia, 6-11 August, pp 214-223 |

[2] | Astrakova, A.; Oliver, DS, Conditioning truncated pluri-Gaussian models to facies observations in ensemble-Kalman-based data assimilation, Math Geosci, 47, 345-367, (2015) · Zbl 1323.86039 |

[3] | Canchumuni SA, Emerick AA, Pacheco MA (2017) Integration of ensemble data assimilation and deep learning for history matching facies models. Paper OTC-28015-MS, presented at the OTC Brasil, Rio de Janeiro, Brazil, 24-26 October |

[4] | Canchumuni SA, Emerick AA, Pacheco M (2018) History matching channelized facies models using ensemble smoother with a deep learning parameterization. Paper presented at the 15th European conference on the mathematics of oil recovery, Barcelona, Spain, 3-6 September |

[5] | Chan S, Elsheikh AH (2017) Parametrization and generation of geological models with generative adversarial networks. arXiv preprint arXiv:1708.01810 |

[6] | Chan S, Elsheikh AH (2018) Parametric generation of conditional geological realizations using generative neural networks. arXiv preprint arXiv:1807.05207 |

[7] | Chang, H.; Zhang, D.; Lu, Z., History matching of facies distribution with the EnKF and level set parameterization, J Comput Phys, 229, 8011-8030, (2010) · Zbl 1425.86017 |

[8] | Chen, C.; Gao, G.; Ramirez, BA; Vink, JC; Girardi, AM, Assisted history matching of channelized models by use of pluri-principal-component analysis, SPE J, 21, 1793-1812, (2016) |

[9] | Deng J, Dong W, Socher R, Li LJ, Li K, Li FF (2009) ImageNet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, IEEE, pp 248-255 |

[10] | Dimitrakopoulos, R.; Mustapha, H.; Gloaguen, E., High-order statistics of spatial random fields: exploring spatial cumulants for modeling complex non-Gaussian and non-linear phenomena, Math Geosci, 42, 65-99, (2010) · Zbl 1184.86012 |

[11] | Dupont E, Zhang T, Tilke P, Liang L, Bailey W (2018) Generating realistic geology conditioned on physical measurements with generative adversarial networks. arXiv preprint arXiv:1802.03065 |

[12] | Echeverría Ciaurri D, Mukerji T, Santos ET (2009) Robust scheme for inversion of seismic and production data for reservoir facies modeling. Paper SEG-2009-2432, presented at the SEG annual meeting, Houston, Texas, 25-30 October |

[13] | Emerick, AA, Investigation on principal component analysis parameterizations for history matching channelized facies models with ensemble-based data assimilation, Math Geosci, 49, 85-120, (2016) · Zbl 1387.86044 |

[14] | Gatys LA, Ecker AS, Bethge M (2015) Texture synthesis using convolutional neural networks. In: Advances in neural information processing systems, pp 262-270 |

[15] | Gatys LA, Ecker AS, Bethge M (2016) Image style transfer using convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2414-2423 |

[16] | Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge · Zbl 1373.68009 |

[17] | Hakim-Elahi, S.; Jafarpour, B., A distance transform for continuous parameterization of discrete geologic facies for subsurface flow model calibration, Water Resour Res, 53, 8226-8249, (2017) |

[18] | Insuasty E, Van den Hof PMJ, Weiland S, Jansen JD (2017) Low-dimensional tensor representations for the estimation of petrophysical reservoir parameters. Paper SPE-182707-MS presented at the SPE Reservoir Simulation Conference, Montgomery, Texas, 20-22 February |

[19] | Isebor, OJ; Echeverría Ciaurri, D.; Durlofsky, LJ, Generalized field-development optimization with derivative-free procedures, SPE J, 19, 891-908, (2014) |

[20] | Jafarpour, B.; Goyal, VK; McLaughlin, DB; Freeman, WT, Compressed history matching: exploiting transform-domain sparsity for regularization of nonlinear dynamic data integration problems, Math Geosci, 42, 1-27, (2010) · Zbl 1185.94011 |

[21] | Johnson J, Alahi A, Li FF (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694-711 |

[22] | Kadian A (2018) Pytorch implementation of an algorithm for artistic style transfer. https://github.com/abhiskk/fast-neural-style/commits/master. Accessed 1 May 2018 |

[23] | Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980. Accessed 1 May 2018 |

[24] | Kitanidis, PK, Parameter uncertainty in estimation of spatial functions: Bayesian analysis, Water Resour Res, 22, 499-507, (1986) |

[25] | Laloy, E.; Hérault, R.; Lee, J.; Jacques, D.; Linde, N., Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network, Adv Water Resour, 110, 387-405, (2017) |

[26] | Laloy, E.; Hérault, R.; Jacques, D.; Linde, N., Training-image based geostatistical inversion using a spatial generative adversarial neural network, Water Resour Res, 54, 381-406, (2018) |

[27] | Liu Y (2017) Multilevel strategy for O-PCA-based history matching using mesh adaptive direct search. Master’s thesis, Stanford University |

[28] | Lu P, Horne RN (2000) A multiresolution approach to reservoir parameter estimation using wavelet analysis. Paper SPE-62985-MS, presented at the SPE annual technical conference and exhibition, Dallas, TX, 1-4 October |

[29] | Mosser, L.; Dubrule, O.; Blunt, MJ, Reconstruction of three-dimensional porous media using generative adversarial neural networks, Phys Rev E, 96, 043,309, (2017) |

[30] | Mosser L, Dubrule O, Blunt MJ (2018) Conditioning of three-dimensional generative adversarial networks for pore and reservoir-scale models. arXiv preprint arXiv:1802.05622 |

[31] | Oliver, DS, Multiple realizations of the permeability field from well test data, SPE J, 1, 145-154, (1996) |

[32] | Pardo-Igúzquiza, E.; Dowd, PA, CONNEC3D: a computer program for connectivity analysis of 3D random set models, Comput Geosci, 29, 775-785, (2003) |

[33] | Paszke A, Gross S, Chintala S, Chanan G, Yang E (2017) Automatic differentiation in PyTorch. NIPS 2017 workshop |

[34] | Ping, J.; Zhang, D., History matching of fracture distributions by ensemble Kalman filter combined with vector based level set parameterization, J Pet Sci Eng, 108, 288-303, (2013) |

[35] | Remy N, Boucher A, Wu J (2009) Applied geostatistics with SGeMS: a user’s guide. Cambridge University Press, Cambridge |

[36] | Reynolds, AC; He, N.; Chu, L.; Oliver, DS, Reparameterization techniques for generating reservoir descriptions conditioned to variograms and well-test pressure data, SPE J, 1, 413-426, (1996) |

[37] | Rwechungura R, Dadashpour M, Kleppe J (2011) Application of particle swarm optimization for parameter estimation integrating production and time lapse seismic data. Paper SPE-146199-MS, presented at the SPE offshore Europe conference and exhibition, Aberdeen, UK, 6-8 September |

[38] | Sarma, P.; Durlofsky, LJ; Aziz, K.; Chen, WH, Efficient real-time reservoir management using adjoint-based optimal control and model updating, Comput Geosci, 10, 3-36, (2006) · Zbl 1161.86303 |

[39] | Sarma, P.; Durlofsky, LJ; Aziz, K., Kernel principal component analysis for efficient, differentiable parameterization of multipoint geostatistics, Math Geosci, 40, 3-32, (2008) · Zbl 1144.86004 |

[40] | Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 |

[41] | Strebelle, S., Conditional simulation of complex geological structures using multiple-point statistics, Math Geol, 34, 1-21, (2002) · Zbl 1036.86013 |

[42] | Tavakoli, R.; Reynolds, AC, History matching with parametrization based on the SVD of a dimensionless sensitivity matrix, SPE J, 15, 495-508, (2010) |

[43] | Torquato, S.; Beasley, JD; Chiew, YC, Two-point cluster function for continuum percolation, J Chem Phys, 88, 6540-6547, (1988) |

[44] | Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3D convolutional networks. Paper presented at the 2015 IEEE international conference on computer vision, Santiago, Chile, 13-16 December, pp 4489-4497 |

[45] | Vo, HX; Durlofsky, LJ, A new differentiable parameterization based on principal component analysis for the low-dimensional representation of complex geological models, Math Geosci, 46, 775-813, (2014) · Zbl 1323.86048 |

[46] | Vo, HX; Durlofsky, LJ, Data assimilation and uncertainty assessment for complex geological models using a new PCA-based parameterization, Comput Geosci, 19, 747-767, (2015) · Zbl 1392.86057 |

[47] | Vo, HX; Durlofsky, LJ, Regularized kernel PCA for the efficient parameterization of complex geological models, J Comput Phys, 322, 859-881, (2016) · Zbl 1351.86031 |

[48] | Wang, Y.; Arns, CH; Rahman, SS; Arns, JY, Porous structure reconstruction using convolutional neural networks, Math Geosci, 50, 781-799, (2018) · Zbl 1402.86005 |

[49] | Zhang, T.; Switzer, P.; Journel, A., Filter-based classification of training image patterns for spatial simulation, Math Geol, 38, 63-80, (2006) · Zbl 1119.86313 |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.