Pairwise estimation of multivariate longitudinal outcomes in a Bayesian setting with extensions to the joint model. (English) Zbl 07346643

Summary: Multiple longitudinal outcomes are theoretically easily modelled via extension of the generalized linear mixed effects model. However, due to computational limitations in high dimensions, in practice these models are applied only in situations with relatively few outcomes. We adapt the solution proposed by S. Fieuws and G. Verbeke [Biometrics 62, No. 2, 424–431 (2006; Zbl 1097.62058)] to the Bayesian setting: fitting all pairwise bivariate models instead of a single multivariate model, and combining the Markov Chain Monte Carlo (MCMC) realizations obtained for each pairwise bivariate model for the relevant parameters. We explore importance sampling as a method to more closely approximate the correct multivariate posterior distribution. Simulation studies show satisfactory results in terms of bias, RMSE and coverage of the 95% credible intervals for multiple longitudinal outcomes, even in scenarios with more limited information and non-continuous outcomes, although the use of importance sampling is not successful. We further examine the incorporation of a time-to-event outcome, proposing the use of Bayesian pairwise estimation of a multivariate GLMM in an adaptation of the corrected two-stage estimation procedure for the joint model for multiple longitudinal outcomes and a time-to-event outcome [K. Mauff et al., Stat. Comput. 30, No. 4, 999–1014 (2020; Zbl 1447.62117)]. The method does not work as well in the case of the corrected two-stage joint model; however, the results are promising and should be explored further.


62-XX Statistics


S-PLUS; MIXOR; Stan; MEMSS; BayesDA; sns
Full Text: DOI


[1] Betancourt, M (2018) A conceptual introduction to Hamiltonian Monte Carlo. arXiv preprint:170102434.
[2] Booth, J, Hobert, J (1999) Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo em algorithm. Journal of the Royal Statistical Society, Series B, 61, 265-85. · Zbl 0917.62058
[3] Breslow, N, Clayton, D (1993) Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88, 9-25. · Zbl 0775.62195
[4] Brilleman, S, Crowther, M, Moreno-Betancur, M, Novik, JB, Dunyak, J, AlHuniti, N, Fox, R, Hammerbacher, J, Wolfe, R (2019) Joint longitudinal and time-to-event models for multilevel hierarchical data. Statistical Methods in Medical Research, 28, 3502-15.
[5] Brown, H, Prescott, R (1999) Applied Mixed Models in Medicine. New York, NY: John Wiley and Sons. · Zbl 0954.62126
[6] Davidian, M, Giltinan, D (1995) Nonlinear Models for Repeated Measurement Data. London: Chapman and Hall.
[7] Demidenko, E (2004) Mixed Models: Theory and Application. New York, NY: John Wiley and Sons. · Zbl 1055.62086
[8] Fahrmeir, L, Tutz, G (1994) Multivariate Stati- stical Modelling Based on Generalized Linear Models. New York, NY: Springer-Verlag. · Zbl 0809.62064
[9] Fieuws, S, Verbeke, G (2004) Joint modelling of the multivariate longitudinal profiles: Pitfalls of the random-effects approach. Statistics in Medicine, 23, 3093-3104.
[10] Fieuws, S, Verbeke, G (2006) Pairwise fitting of mixed models for the joint modeling of multivariate longitudinal proles. Biometrics, 62, 424-31. · Zbl 1097.62058
[11] Fieuws, S, Verbeke, G, Molenberghs, G (2007) Random-effects models for multivariate repeated measures. Statistical Methods in Medical Research, 16, 387-97.
[12] Gelfand, A, Smith, A (1990) Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398-409. · Zbl 0702.62020
[13] Gelman, A, Carlin, J, Stern, H, Dunson, D, Vehtari, A, Rubin, D (2013) Bayesian Data Analysis, 3rd Edition. Boca Raton, FL: CRC Press.
[14] Girolami, M, Calderhead, B (2011) Riemann manifold Langevin and Hamiltonian Monte Carlo methods. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 73, 123-214. · Zbl 1411.62071
[15] Guan, Y, Haran, M (2016) A computationally efficient projection-based approach for spatial generalized linear mixed models. Journal of Computational and Graphical Statistics, 27. doi: 10.1080/10618600.2018.1425625.
[16] Gueorguieva, R (1999) Models for repeated measures of a multivariate response. PhD Dissertation, Department of Statistics, University of Florida, Gainesville.
[17] Hedeker, D, Gibbons, R (1994) A random- effects ordinal regression model for multilevel analysis. Biometrics, 50, 933-44. · Zbl 0826.62049
[18] Hedeker, D, Gibbons, R (1996) Mixor: A computer program for mixed-effects ordinal regression analysis. Computer Methods and Programs in Biomedicine, 49, 157-76.
[19] Hoffman, M, Gelman, A (2014) The no-u-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo. The Journal of Machine Learning Research, 15, 1593-1623. · Zbl 1319.60150
[20] Ionides, E (2008) Truncated importance sampling. Journal of Computational and Graphical Statistics, 17, 295-311.
[21] Laird, N, Ware, J (1982) Random effects models for longitudinal data. Biometrics, 38, 963-74. · Zbl 0512.62107
[22] Lewandowski, D, Kurowicka, D, Joe, H (2009) Generating random correlation matrices based on vines and extended onion method. Journal of Multivariate Analysis, 100, 1989-2001. · Zbl 1170.62042
[23] Liu, J (2001) Monte Carlo Strategies in Scientific Computing. New York, NY: Springer-Verlag. · Zbl 0991.65001
[24] MacKay, D (2003) Information Theory, Inference, and Learning Algorithms. Cambridge: Cambridge University Press. · Zbl 1055.94001
[25] Mahani, A, Hasan, A, Jiang, M, Sharabiani, M (2016) Stochastic Newton sampler: R package sns. Journal of Statistical Software, Code Snippets, 74, 1-33.
[26] Mauff, K, Steyerberg, E, Kardys, I, Boersma, E, Rizopoulos, D (2020) Joint models with multiple longitudinal outcomes and a time-to-event outcome. Statistics and Computing doi:10.1007/s11222-020-09927-9. · Zbl 1447.62117
[27] McCulloch, C (1997) Maximum likelihood algorithms for generalized linear mixed models. Journal of the American Statistical Association, 92, 162-70. · Zbl 0889.62061
[28] Monnahan, C, Thorson, J, Branch, T (2017) Faster estimation of Bayesian models in ecology using Hamiltonian Monte Carlo. Methods in Ecology and Evolution, 8, 339-48.
[29] Neal, R (2011) MCMC Using Hamiltonian dynamics. In Handbook of Markov Chain Monte Carlo, edited by Brooks, S, Gelman, G, Jones, G, Meng, XL, pages 113-162. Boca Raton, FL: CRC Press.
[30] Owen, A (2013) Monte carlo theory, methods and examples. URL https://statweb.stanford.edu/owen/mc/Ch-var-is.pdf (last accessed 17 August 2020).
[31] Pinheiro, J, Bates, D (1995) Approximation to the loglikelihood function in the nonlinear mixed effects model. Journal of Computational and Graphical Statistics, 4, 12-35.
[32] Pinheiro, J, Bates, D (2000) Mixed-Effects Models in S and S-PLUS. New York, NY: Springer-Verlag. · Zbl 0953.62065
[33] Robert, C, Casella, G (2004) Monte Carlo Statistical Methods. New York, NY: Springer-Verlag. · Zbl 1096.62003
[34] Stan Development Team (2014) Stan: A C++ library for probability and sampling, version 2.8.0. URL http://mc-stan.org/ (last accessed 17 August 2020).
[35] Wolfinger, R, O’Connell, M (1993) Generali- zed linear mixed models: A pseudo- likelihood approach. Journal of Statistical Computation and Simulations, 48, 233-43. · Zbl 0833.62067
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.