A hybrid landmark Aalen-Johansen estimator for transition probabilities in partially non-Markov multi-state models. (English) Zbl 07469155

Summary: Multi-state models are increasingly being used to model complex epidemiological and clinical outcomes over time. It is common to assume that the models are Markov, but the assumption can often be unrealistic. The Markov assumption is seldomly checked and violations can lead to biased estimation of many parameters of interest. This is a well known problem for the standard Aalen-Johansen estimator of transition probabilities and several alternative estimators, not relying on the Markov assumption, have been suggested. A particularly simple approach known as landmarking have resulted in the Landmark-Aalen-Johansen estimator. Since landmarking is a stratification method a disadvantage of landmarking is data reduction, leading to a loss of power. This is problematic for “less traveled” transitions, and undesirable when such transitions indeed exhibit Markov behaviour. Introducing the concept of partially non-Markov multi-state models, we suggest a hybrid landmark Aalen-Johansen estimator for transition probabilities. We also show how non-Markov transitions can be identified using a testing procedure. The proposed estimator is a compromise between regular Aalen-Johansen and landmark estimation, using transition specific landmarking, and can drastically improve statistical power. We show that the proposed estimator is consistent, but that the traditional variance estimator can underestimate the variance of both the hybrid and landmark estimator. Bootstrapping is therefore recommended. The methods are compared in a simulation study and in a real data application using registry data to model individual transitions for a birth cohort of 184 951 Norwegian men between states of sick leave, disability, education, work and unemployment.


62Nxx Survival analysis and censored data
62P10 Applications of statistics to biology and medical sciences; meta analysis


mstate; invGauss
Full Text: DOI arXiv


[1] Aalen, OO; Johansen, S., An empirical transition matrix for non-homogeneous Markov chains based on censored observations, Scand J Stat, 5, 3, 141-150 (1978) · Zbl 0383.62058
[2] Aalen, OO; Borgan, Ø.; Fekjær, H., Covariate adjustment of event histories estimated from Markov chains: the additive approach, Biometrics, 57, 4, 993-1001 (2001) · Zbl 1209.62247
[3] Aalen, OO; Borgan, Ø.; Gjessing, H., Survival and event history analysis: a process point of view (2008), New York: Springer, New York · Zbl 1204.62165
[4] Allignol, A.; Beyersmann, J.; Gerds, T.; Latouche, A., A competing risks approach for nonparametric estimation of transition probabilities in a non-Markov illness-death model, Lifetime Data Anal, 20, 4, 495-513 (2014) · Zbl 1359.62471
[5] Andersen, PK; Keiding, N., Multi-state models for event history analysis, Stat Methods Med Res, 11, 2, 91-115 (2002) · Zbl 1121.62568
[6] Andersen, PK; Borgan, Ø.; Gill, RD; Keiding, N., Statistical models based on counting processes (1993), New York: Springer, New York
[7] Datta, S.; Satten, GA, Validity of the Aalen-Johansen estimators of stage occupation probabilities and Nelson-Aalen estimators of integrated transition hazards for non-Markov models, Stat Probab Lett, 55, 4, 403-411 (2001) · Zbl 0998.62072
[8] Datta, S.; Satten, GA, Estimation of integrated transition hazards and stage occupation probabilities for non-Markov systems under dependent censoring, Biometrics, 58, 4, 792-802 (2002) · Zbl 1210.62115
[9] de Uña-Álvarez, J.; Meira-Machado, L., Nonparametric estimation of transition probabilities in the non-Markov illness-death model: A comparative study, Biometrics, 71, 2, 364-375 (2015) · Zbl 1390.62246
[10] de Wreede, LC; Fiocco, M.; Putter, H., mstate: an R package for the analysis of competing risks and multi-state models, J Stat Softw, 38, 7, 1-30 (2011)
[11] Gill, RD; Johansen, S., A survey of product-integration with a view toward application in survival analysis, Ann Stat, 18, 4, 1501-1555 (1990) · Zbl 0718.60087
[12] Glidden, DV, Robust inference for event probabilities with non-Markov event data, Biometrics, 58, 2, 361-368 (2002) · Zbl 1209.62047
[13] Gran, JM; Lie, SA; Øyeflaten, I.; Borgan, Ø.; Aalen, OO, Causal inference in multi-state models-sickness absence and work for 1145 participants after work rehabilitation, BMC Public Health, 15, 1, 1082 (2015)
[14] Gunnes, N.; Borgan, Ø.; Aalen, OO, Estimating stage occupation probabilities in non-Markov models, Lifetime Data Anal, 13, 2, 211-240 (2007) · Zbl 1162.62417
[15] Hazard, D.; Kaier, K.; von Cube, M.; Grodd, M.; Bugiera, L.; Lambert, J.; Wolkewitz, M., Joint analysis of duration of ventilation, length of intensive care, and mortality of covid-19 patients: a multistate approach, BMC Med Res Methodol, 20, 1, 206 (2020)
[16] Hoff, R.; Corbett, K.; Mehlum, IS; Mohn, FA; Kristensen, P.; Hanvold, TN; Gran, JM, The impact of completing upper secondary education - a multi-state model for work, education and health in young men, BMC Public Health, 18, 556 (2018)
[17] Hoff, R.; Putter, H.; Mehlum, IS; Gran, JM, Landmark estimation of transition probabilities in non-Markov multi-state models with covariates, Lifetime Data Anal, 25, 4, 660-680 (2019) · Zbl 1436.62564
[18] Hougaard, P., Multi-state models: a review, Lifetime Data Anal, 5, 3, 239-264 (1999) · Zbl 0934.62112
[19] Meira-Machado, LF; de Uña-Álvarez, J.; Cadarso-Suárez, C.; Andersen, PK, Multi-state models for the analysis of time-to-event data, Stat Methods Med Res, 18, 2, 195-222 (2008)
[20] Nießl A, Allignol A, Beyersmann J, Müller C (2020) Estimating state occupation and transition probabilities in non-markov multi-state models subject to both random left-truncation and right-censoring. arXiv preprint arXiv:2004.06514 pp 1-21
[21] Overgaard, M., State occupation probabilities in non-Markov models, Math Methods Stat, 28, 279-290 (2019) · Zbl 1442.62216
[22] Putter, H.; Spitoni, C., Non-parametric estimation of transition probabilities in non-Markov multi-state models: The landmark Aalen-Johansen estimator, Stat Methods Med Res, 27, 7, 2081-2092 (2018)
[23] Putter, H.; Fiocco, M.; Geskus, RB, Tutorial in biostatistics: competing risks and multi-state models, Stat Med, 26, 11, 2389-2430 (2007)
[24] Titman, AC, Transition probability estimates for non-Markov multi-state models, Biometrics, 71, 4, 1034-1041 (2015) · Zbl 1419.62458
[25] Titman AC, Putter H (2020) General tests of the Markov property in multi-state models. Biostatistics pp 1-17
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.