A new avenue for Bayesian inference with INLA. (English) Zbl 07710147

Summary: Integrated Nested Laplace Approximations (INLA) has been a successful approximate Bayesian inference framework since its proposal by H. Rue et al. [J. R. Stat. Soc., Ser. B, Stat. Methodol. 71, No. 2, 319–392 (2009; Zbl 1248.62156)]. The increased computational efficiency and accuracy when compared with sampling-based methods for Bayesian inference like MCMC methods, are some contributors to its success. Ongoing research in the INLA methodology and implementation thereof in the R package R-INLA, ensures continued relevance for practitioners and improved performance and applicability of INLA. The era of big data and some recent research developments, presents an opportunity to reformulate some aspects of the classic INLA formulation, to achieve even faster inference, improved numerical stability and scalability. The improvement is especially noticeable for data-rich models. Various examples of data-rich models, like Cox’s proportional hazards model, an item-response theory model, a spatial model including prediction, and a three-dimensional model for fMRI data are used to illustrate the efficiency gains in a tangible manner.


62-08 Computational methods for problems pertaining to statistics


Zbl 1248.62156
Full Text: DOI arXiv


[1] Abdul Fattah, E.; Van Niekerk, J.; Rue, H., Smart gradient - an adaptive technique for improving gradient estimation, Found. Data Sci., 4, 1, 123-136 (2022) · Zbl 07547911
[2] Alene, K. A.; Elagali, A.; Barth, D. D.; Rumisha, S. F.; Amratia, P.; Weiss, D. J.; Atalell, K. A.; Erena, A. K.; Gething, P. W.; Clements, A. C., Spatial codistribution of HIV, tuberculosis and malaria in Ethiopia, BMJ Glob. Health, 7, 2, Article e007599 pp. (2022)
[3] Bakka, H.; Rue, H.; Fuglstad, G.-A.; Riebler, A.; Bolin, D.; Illian, J.; Krainski, E.; Simpson, D.; Lindgren, F., Spatial modeling with R-INLA: a review, Wiley Interdiscip. Rev.: Comput. Stat., 10, 6, Article e1443 pp. (2018)
[4] Bermudez, P.d. Z.; Marín, J. M.; Rue, H.; Veiga, H., Integrated nested Laplace approximations for threshold stochastic volatility models, Econom. Stat. (2023), In press
[5] Bilal, U.; Tabb, L. P.; Barber, S.; Diez Roux, A. V., Spatial inequities in COVID-19 testing, positivity, confirmed cases, and mortality in 3 US cities: an ecological study, Ann. Intern. Med., 174, 7, 936-944 (2021)
[6] Bürkner, P.-C., Bayesian item response modeling in R with brms and Stan, J. Stat. Softw., 100, 5, 1-54 (2021)
[7] Choi, Y.-J.; Asilkalkan, A., R packages for item response theory analysis: description and features, Measurement, 17, 3, 168-175 (2019)
[8] Coll, M.; Pennino, M. G.; Steenbeek, J.; Solé, J.; Bellido, J. M., Predicting marine species distributions: complementarity of food-web and Bayesian hierarchical modelling approaches, Ecol. Model., 405, 86-101 (2019)
[9] Davies, B.; Parkes, B. L.; Bennett, J.; Fecht, D.; Blangiardo, M.; Ezzati, M.; Elliott, P., Community factors and excess mortality in first wave of the COVID-19 pandemic in England, Nat. Commun., 12, 1, 1-9 (2021)
[10] de Souza, W. M.; Buss, L. F.; Candido, D.d. S.; Carrera, J.-P.; Li, S.; Zarebski, A. E.; Pereira, R. H.M.; Prete, C. A.; de Souza-Santos, A. A.; Parag, K. V., Epidemiological and clinical characteristics of the COVID-19 epidemic in Brazil, Nat. Hum. Behav., 4, 8, 856-865 (2020)
[11] Dwyer-Lindgren, L.; Cork, M. A.; Sligar, A.; Steuben, K. M.; Wilson, K. F.; Provost, N. R.; Mayala, B. K.; VanderHeide, J. D.; Collison, M. L.; Hall, J. B., Mapping HIV prevalence in sub-Saharan Africa between 2000 and 2017, Nature, 570, 7760, 189-193 (2019)
[12] Fischl, B., Freesurfer, NeuroImage, 62, 2, 774-781 (2012)
[13] Gaedke-Merzhäuser, L.; van Niekerk, J.; Schenk, O.; Rue, H., Parallelized integrated nested Laplace approximations for fast Bayesian inference (2022) · Zbl 1502.62016
[14] Holford, T. R., The analysis of rates and of survivorship using log-linear models, Biometrics, 299-305 (1980) · Zbl 0463.62095
[15] Isaac, N. J.; Jarzyna, M. A.; Keil, P.; Dambly, L. I.; Boersch-Supan, P. H.; Browning, E.; Freeman, S. N.; Golding, N.; Guillera-Arroita, G.; Henrys, P. A., Data integration for large-scale models of species distributions, Trends Ecol. Evol., 35, 1, 56-67 (2020)
[16] Konstantinoudis, G.; Padellini, T.; Bennett, J.; Davies, B.; Ezzati, M.; Blangiardo, M., Long-term exposure to air-pollution and COVID-19 mortality in England: a hierarchical spatial analysis, Environ. Int., 146, Article 106316 pp. (2021)
[17] Kontis, V.; Bennett, J. E.; Rashid, T.; Parks, R. M.; Pearson-Stuttard, J.; Guillot, M.; Asaria, P.; Zhou, B.; Battaglini, M.; Corsetti, G., Magnitude, demographics and dynamics of the effect of the first wave of the COVID-19 pandemic on all-cause mortality in 21 industrialized countries, Nat. Med., 26, 12, 1919-1928 (2020)
[18] Krainski, E. T.; Gómez-Rubio, V.; Bakka, H.; Lenzi, A.; Castro-Camilo, D.; Simpson, D.; Lindgren, F.; Rue, H., Advanced Spatial Modeling with Stochastic Partial Differential Equations Using R and INLA (2018), Chapman and Hall/CRC
[19] Laird, N.; Olivier, D., Covariance analysis of censored survival data using log-linear analysis techniques, J. Am. Stat. Assoc., 76, 374, 231-240 (1981) · Zbl 0473.62045
[20] Lillini, R.; Tittarelli, A.; Bertoldi, M.; Ritchie, D.; Katalinic, A.; Pritzkuleit, R.; Launoy, G.; Launay, L.; Guillaume, E.; Žagar, T., Water and soil pollution: ecological environmental study methodologies useful for public health projects. A literature review, Rev. Environ. Contam. Toxicol., 256, 179-214 (2021)
[21] Lindenmayer, D.; Taylor, C.; Blanchard, W., Empirical analyses of the factors influencing fire severity in southeastern Australia, Ecosphere, 12, 8, Article e03721 pp. (2021)
[22] Lindgren, F.; Rue, H., On the second-order model for irregular locations, Scand. J. Stat., 35, 4, 691-700 (2008) · Zbl 1199.60276
[23] Lindgren, F.; Rue, H.; Lindström, J., An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach, J. R. Stat. Soc., Ser. B, Stat. Methodol., 73, 4, 423-498 (2011) · Zbl 1274.62360
[24] Lindquist, M. A., The statistical analysis of fMRI data, Stat. Sci., 23, 4, 439-464 (2008) · Zbl 1329.62296
[25] Mair, P.; Gruber, K., Bayesian explanatory additive IRT models, Br. J. Math. Stat. Psychol., 75, 1, 59-87 (2022)
[26] Martin, A. D.; Quinn, K. M.; Park, J. H., MCMCpack: Markov chain Monte Carlo in R, J. Stat. Softw., 49, 1-21 (2011)
[27] Martínez-Minaya, J.; Cameletti, M.; Conesa, D.; Pennino, M. G., Species distribution modeling: a statistical review with focus in spatio-temporal issues, Stoch. Environ. Res. Risk Assess., 32, 11, 3227-3244 (2018)
[28] Martino, S.; Aas, K.; Lindqvist, O.; Neef, R. L.; Rue, H., Estimating stochastic volatility models using integrated nested Laplace approximations, Eur. J. Finance, 17, 7, 487-503 (2011)
[29] Martino, S.; Akerkar, R.; Rue, H., Approximate Bayesian inference for survival models, Scand. J. Stat., 38, 3, 514-528 (2011) · Zbl 1246.62059
[30] Martins, D. M., Estado da arte das pesquisas sobre ENEM no Brasil: state of the art of research on ENEM in Brazil, Latin American, J. Dev., 3, 5, 2898-2907 (2021)
[31] Mejia, A. F.; Yue, Y.; Bolin, D.; Lindgren, F.; Lindquist, M. A., A Bayesian general linear modeling approach to cortical surface fMRI data analysis, J. Am. Stat. Assoc., 115, 530, 501-520 (2020) · Zbl 1445.62283
[32] Mielke, K. P.; Claassen, T.; Busana, M.; Heskes, T.; Huijbregts, M. A.; Koffijberg, K.; Schipper, A. M., Disentangling drivers of spatial autocorrelation in species distribution models, Ecography, 43, 12, 1741-1751 (2020)
[33] Millett, G. A.; Jones, A. T.; Benkeser, D.; Baral, S.; Mercer, L.; Beyrer, C.; Honermann, B.; Lankiewicz, E.; Mena, L.; Crowley, J. S., Assessing differential impacts of COVID-19 on black communities, Ann. Epidemiol., 47, 37-44 (2020)
[34] Muttai, H.; Guyah, B.; Achia, T.; Musingila, P.; Nakhumwa, J.; Oyoo, R.; Olweny, W.; Odeny, R.; Ohaga, S.; Agot, K., Mapping geographic clusters of new HIV diagnoses to inform granular-level interventions for HIV epidemic control in western Kenya, BMC Public Health, 21, 1, 1-15 (2021)
[35] Pimont, F.; Fargeon, H.; Opitz, T.; Ruffault, J.; Barbero, R.; Martin-StPaul, N.; Rigolot, E.; Rivière, M.; Dupuy, J.-L., Prediction of regional wildfire activity in the probabilistic Bayesian framework of Firelihood, Ecol. Appl., 31, 5, Article e02316 pp. (2021)
[36] Pinto, G.; Rousseu, F.; Niklasson, M.; Drobyshev, I., Effects of human-related and biotic landscape features on the occurrence and size of modern forest fires in Sweden, Agric. For. Meteorol., 291, Article 108084 pp. (2020)
[37] Rodriguez-Diaz, C. E.; Guilamo-Ramos, V.; Mena, L.; Hall, E.; Honermann, B.; Crowley, J. S.; Baral, S.; Prado, G. J.; Marzan-Rodriguez, M.; Beyrer, C., Risk for COVID-19 infection and death among Latinos in the United States: examining heterogeneity in transmission dynamics, Ann. Epidemiol., 52, 46-53 (2020)
[38] Rue, H.; Held, L., Gaussian Markov Random Fields: Theory and Applications (2005), CRC Press · Zbl 1093.60003
[39] Rue, H.; Martino, S.; Chopin, N., Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations, J. R. Stat. Soc., Ser. B, Stat. Methodol., 71, 2, 319-392 (2009) · Zbl 1248.62156
[40] Rue, H.; Riebler, A. I.; Sørbye, S. H.; Illian, J. B.; Simpson, D. P.; Lindgren, F. K., Bayesian computing with INLA: a review, Annu. Rev. Stat. Appl., 4, 395-421 (2017)
[41] Sanyal, S.; Rochereau, T.; Maesano, C. N.; Com-Ruelle, L.; Annesi-Maesano, I., Long-term effect of outdoor air pollution on mortality and morbidity: a 12-year follow-up study for metropolitan France, Int. J. Environ. Res. Public Health, 15, 11, 2487 (2018)
[42] Shaddick, G.; Thomas, M. L.; Amini, H.; Broday, D.; Cohen, A.; Frostad, J.; Green, A.; Gumy, S.; Liu, Y.; Martin, R. V., Data integration for the assessment of population exposure to ambient air pollution for global burden of disease assessment, Environ. Sci. Technol., 52, 16, 9069-9078 (2018)
[43] Simpson, D.; Rue, H.; Riebler, A.; Martins, T. G.; Sørbye, S. H., Penalising model component complexity: a principled, practical approach to constructing priors, Stat. Sci., 32, 1, 1-28 (2017) · Zbl 1442.62060
[44] Sørbye, S. H.; Rue, H., Scaling intrinsic Gaussian Markov random field priors in spatial modelling, Spat. Stat., 8, 39-51 (2014)
[45] Spencer, D.; Yue, Y. R.; Bolin, D.; Ryan, S.; Mejia, A. F., Spatial Bayesian GLM on the cortical surface produces reliable task activations in individuals and groups, NeuroImage, Article 118908 pp. (2022)
[46] Stringer, A.; Brown, P.; Stafford, J., Fast, scalable approximations to posterior distributions in extended latent Gaussian models (2022)
[47] Tafadzwa, D.; Julien, R.; Lina, B.; Eliane, R.; Frederique, C.; Leigh, J.; Elvira, S.; Victor, O.; Mazvita, S.-M.; Matthias, E., Spatiotemporal modelling and mapping of cervical cancer incidence among HIV positive women in South Africa: a nationwide study, Int. J. Health Geogr., 20, 1, 1-12 (2021)
[48] Takahashi, K., Formation of sparse bus impedance matrix and its application to short circuit study, (Proc. PICA Conference. Proc. PICA Conference, June 1973 (1973))
[49] Tierney, L.; Kass, R. E.; Kadane, J. B., Fully exponential Laplace approximations to expectations and variances of nonpositive functions, J. Am. Stat. Assoc., 84, 407, 710-716 (1989) · Zbl 0682.62012
[50] (van der Linden, W. J., Handbook of Item Response Theory (2016), Chapman and Hall/CRC) · Zbl 1331.62001
[51] Van Niekerk, J.; Rue, H., Correcting the Laplace method with variational Bayes, J. Mach. Learn. Res. (2021) · Zbl 1478.62067
[52] Venables, W. N.; Ripley, B. D., Modern Applied Statistics with S-PLUS (2013), Springer Science & Business Media · Zbl 0927.62002
[53] Zellner, A., Optimal information processing and Bayes’s theorem, Am. Stat., 42, 4, 278-280 (1988)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.