Modeling intensive polytomous time-series eye-tracking data: a dynamic tree-based item response model. (English) Zbl 1447.62124

Summary: This paper presents a dynamic tree-based item response (IRTree) model as a novel extension of the autoregressive generalized linear mixed effect model (dynamic GLMM). We illustrate the unique utility of the dynamic IRTree model in its capability of modeling differentiated processes indicated by intensive polytomous time-series eye-tracking data. The dynamic IRTree was inspired by but is distinct from the dynamic GLMM which was previously presented by the first author et al. [Psychometrika 83, No. 3, 751–771 (2018; Zbl 1422.62345)]. Unlike the dynamic IRTree, the dynamic GLMM is suitable for modeling intensive binary time-series eye-tracking data to identify visual attention to a single interest area over all other possible fixation locations. The dynamic IRTree model is a general modeling framework which can be used to model change processes (trend and autocorrelation) and which allows for decomposing data into various sources of heterogeneity. The dynamic IRTree model was illustrated using an experimental study that employed the visual-world eye-tracking technique. The results of a simulation study showed that parameter recovery of the model was satisfactory and that ignoring trend and autoregressive effects resulted in biased estimates of experimental condition effects in the same conditions found in the empirical study.


62P15 Applications of statistics to psychology
62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)


Zbl 1422.62345


R; lme4; irtrees; cquad; Stata; Stan
Full Text: DOI


[1] Allopenna, PD; Magnuson, JS; Tanenhaus, MK, Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models, Journal of Memory and Language, 38, 419-439 (1998)
[2] Altmann, GT; Kamide, Y., Incremental interpretation at verbs: Restricting the domain of subsequent reference, Cognition, 73, 247-264 (1999)
[3] Baayen, RH; Davidson, DJ; Bates, DM, Mixed-effects modeling with crossed random effects for subjects and items, Journal of Memory and Language, 59, 390-412 (2008)
[4] Barr, DJ, Analyzing ’visual world’ eyetracking data using multilevel logistic regression, Journal of Memory and Language, 59, 457-474 (2008)
[5] Barr, DJ, Pragmatic expectations and linguistic evidence: Listeners anticipate but do not integrate common ground, Cognition, 109, 18-40 (2008)
[6] Barr, DJ; Levy, R.; Scheepers, C.; Tily, HJ, Random effects structure for confirmatory hypothesis testing: Keep it maximal, Journal of Memory and Language, 68, 255-278 (2013)
[7] Barrett, HC; Broesch, T.; Scott, RM; He, Z.; Baillargeon, R.; Wu, D., Early false-belief understanding in traditional non-western societies, Proceedings of the Royal Society of London B: Biological Sciences, 280, 2012-2654 (2013)
[8] Bartolucci, F.; Nigro, V., A dynamic model for binary panel data with unobserved heterogeneity admitting a \(n\)-consistent conditional estimator, Econometrica, 78, 719-733 (2010) · Zbl 1187.62195
[9] Batchelder, WH; Crowther, CS, Multinomial processing tree models of factorial categorization, Journal of Mathematical Psychology, 41, 45-55 (1997) · Zbl 0882.62115
[10] Batchelder, WH; Riefer, DM, Theoretical and empirical review of multinomial process tree modeling, Psychonomic Bulletin & Review, 6, 57-86 (1999)
[11] Bates, D., Mächler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H., et al. (2018). Package “lme4”: Linear mixed-effects models using ‘eigen’ and s4. Retrieved March 10, 2018 from https://cran.r-project.org/web/packages/lme4/lme4.pdf.
[12] Böckenholt, U., Modeling multiple response processes in judgment and choice, Psychological Methods, 17, 4, 665-678 (2012)
[13] Böckenholt, U., Measuring response styles in Likert items, Psychological Methods, 22, 69-83 (2017)
[14] Bringmann, LF; Hamaker, EL; Vigo, DE; Aubert, A.; Borsboom, D.; Tuerlinckx, F., Changing dynamics: Time-varying autoregressive models using generalized additive modeling, Psychological Methods, 22, 409-425 (2017)
[15] Brown-Schmidt, S., The role of executive function in perspective-taking during on-line language comprehension, Psychonomic Bulletin & Review, 16, 893-900 (2009)
[16] Brown-Schmidt, S., Partner-specific interpretation of maintained referential precedents during interactive dialog, Journal of Memory and Language, 61, 171-190 (2009)
[17] Brown-Schmidt, S., Beyond common and privileged: Gradient representations of common ground in real-time language use, Language and Cognitive Processes, 27, 62-89 (2012)
[18] Brown-Schmidt, S.; Gunlogson, C.; Tanenhaus, MK, Addressees distinguish shared from private information when interpreting questions during interactive conversation, Cognition, 107, 1122-1134 (2008)
[19] Browne, MW; Nesselroade, JR; Maydeu-Olivares, A.; McArdle, JJ, Representing psychological processes with dynamic factor models: Some promising uses and extensions of autoregressive moving average time series models, Multivariate applications book series. Contemporary psychometrics: A festschrift for Roderick P. McDonald, 415-452 (2005), Mahwah, NJ: Lawrence Erlbaum Associates Publishers, Mahwah, NJ
[20] Burnham, KP; Anderson, DR, Model selection and multimodel inference: A practical information-theoretical approach (2004), New York, NY: Springer, New York, NY
[21] Carpenter, B.; Gelman, A.; Hoffman, M.; Lee, D.; Goodrich, B.; Betancourt, M.; Riddell, A., Stan: A probabilistic programming language, Journal of Statistical Software, 76, 1-32 (2017)
[22] Chatfield, C., The analysis of time series: An introduction (2004), London: Chapman Hall, London · Zbl 0732.62088
[23] Cho, S-J; De Boeck, P., A note on \(N\) in Bayesian information criterion for item response models, Applied Psychological Measurement, 42, 169-172 (2018)
[24] Cho, S.-J., Brown-Schmidt, S., & Lee, W.-y. (2018). Autoregressive generalized linear mixed effect models with crossed random effects: An application to intensive binary time series eye-tracking data. Psychometrika, 83, 751-771. 10.1007/s11336-018-9604-2. · Zbl 1422.62345
[25] Clark, HH, The language-as-fixed-effect fallacy: A critique of language statistics in psychological research, Journal of Verbal Learning and Verbal Behavior, 12, 335-359 (1973)
[26] Cox, MD, The analysis of binary data (1970), London: Chapman and Hall, London
[27] Craigmile, PF; Peruggia, M.; Van Zandt, T.; Chow, S-M; Ferrer, E.; Hsieh, F., Detrending response time series, Statistical methods for modeling human dynamics: An interdisciplinary dialogue, 213-240 (2010), Boca Raton, FL: Taylor & Francis, Boca Raton, FL
[28] Curran, PJ; Bollen, KA; Collins, LM; Sayer, AG, The best of both worlds: Combining autoregressive and latent curve models, Decade of behavior. New methods for the analysis of change (2001), Washington, DC: American Psychological Association, Washington, DC
[29] Curran, PJ; Lee, T.; Howard, AL; Lane, S.; MacCallum, R.; Harring, JR; Hancock, GR, Disaggregating within-person and between-person effects in multilevel and structural equation growth models, CILVR series on latent variable methodology. Advances in longitudinal methods in the social and behavioral sciences, 217-253 (2012), Charlotte, NC: IAP Information Age Publishing, Charlotte, NC
[30] De Boeck, P.; Partchev, I., IRTrees: Tree-based item response models of the GLMM family, Journal of Statistical Software, 48, 1-28 (2012)
[31] De Boeck, P.; Cho, S-J, IRTree modeling of cognitive processes based on outcome and intermediate data (2019), College Park: Maryland Assessment Research Center (MARC), College Park
[32] Embretson, SE; Reise, SP, Item response theory for psychologists (2000), Mahwah, NJ: Lawrence-Erlbaum, Mahwah, NJ
[33] Fahrmeir, L., Posterior mode estimation by extended kalman filtering for multivariate dynamic generalized linear models, Journal of the American Statistical Association, 87, 501-509 (1992) · Zbl 0781.62147
[34] Gamerman, D., Markov chain Monte Carlo for dynamic generalised linear models, Biometrika, 85, 215-227 (1998) · Zbl 0904.62083
[35] Greven, S.; Kneib, T., On the behaviour of marginal and conditional AIC in linear mixed models, Biometrika, 97, 773-789 (2010) · Zbl 1204.62114
[36] Hallett, PE; Boff, KR; Kaufman, L.; Thomas, JP, Eye movements, Handbook of perception and human performance, 10.1-10.112 (1986), New York, NY: Wiley, New York, NY
[37] Hamaker, EL; Grasman, RP, To center or not to center? Investigating inertia with a multilevel autoregressive model, Frontiers in Psychology, 5, 1492 (2015)
[38] Hanna, JE; Tanenhaus, MK; Trueswell, JC, The effects of common ground and perspective on domains of referential interpretation, Journal of Memory and Language, 49, 43-61 (2003)
[39] Hsiao, C., Analysis of panel data (2003), New York: Cambridge University Press, New York
[40] Hung, Y.; Zarnitsyna, V.; Zhang, Y.; Zhu, C.; Wu, CJ, Binary time series modeling with application to adhesion frequency experiments, Journal of the American Statistical Association, 103, 1248-1259 (2008) · Zbl 1205.62131
[41] Jaeger, TF, Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models, Journal of Memory and Language, 59, 434-446 (2008)
[42] Jahng, S.; Wood, PK; Trull, TJ, Analysis of affective instability in ecological momentary assessment: Indices using successive difference and group comparison via multilevel modeling, Psychological Methods, 13, 354-75 (2008)
[43] Jeon, M.; De Boeck, P., A generalized item response tree model for psychological assessments, Behavior Research Methods, 48, 1070-1085 (2016)
[44] Jeon, M.; Rabe-Hesketh, S., An autoregressive growth model for longitudinal item analysis, Psychometrika, 81, 830-850 (2016) · Zbl 1345.62150
[45] Klauer, KC, Hierarchical multinomial processing tree models: A latent-trait approach, Psychometrika, 75, 70-98 (2010) · Zbl 1272.62126
[46] Koval, P.; Kuppens, P.; Allen, NB; Sheeber, L., Getting stuck in depression: The roles of rumination and emotional inertia, Cognition and Emotion, 26, 1412-1427 (2012)
[47] Kuppens, P.; Allen, NB; Sheeber, LB, Emotional inertia and psychological adjustment, Psychological Science, 21, 984-991 (2010)
[48] Lüdtke, O.; Marsh, HW; Robitzsch, A.; Trautwein, U.; Asparouhov, T.; Muthén, B., The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies, Psychological Methods, 13, 203-229 (2008)
[49] MacDonald, MC, How language production shapes language form and comprehension, Frontiers in Psychology, 4, 226 (2013)
[50] Matzke, D.; Dolan, CV; Batchelder, WH; Wagenmakers, E-J, Bayesian estimation of multinomial processing tree models with heterogeneity in participants and items, Psychometrika, 80, 205-235 (2015) · Zbl 1314.62275
[51] McMurray, B.; Samelson, VM; Lee, SH; Tomblin, JB, Individual differences in online spoken word recognition: Implications for SLI, Cognitive Psychology, 60, 1-39 (2010)
[52] McMurray, B.; Klein-Packard, J.; Tomblin, JB, A real-time mechanism underlying lexical deficits in developmental language disorder: Between-word inhibition, Cognition, 191, 104000 (2019)
[53] Merali, N.; Veeramootoo, D.; Singh, S., Eye-tracking technology in surgical training, Journal of Investigative Surgery, 32, 587-593 (2019)
[54] Molenaar, PC, A dynamic factor model for the analysis of multivariate time series, Psychometrika, 50, 181-202 (1985) · Zbl 0603.62099
[55] Mozuraitis, M.; Chambers, CG; Daneman, M., Privileged versus shared knowledge about object identity in real-time referential processing, Cognition, 142, 148-165 (2015)
[56] Nadig, AS; Sedivy, JC, Evidence of perspective-taking constraints in children’s on-line reference resolution, Psychological Science, 13, 4, 329-336 (2002)
[57] Nickell, S., Biases in dynamic models with fixed effects, Econometrica: Journal of the Econometric Society, 49, 1417-1426 (1981) · Zbl 0464.90012
[58] Qu, S., & Chai, J. Y. (2007). An exploration of eye gaze in spoken language processing for multimodal conversational interfaces. In C. L. Sidner, T. Schultz, M. Stone, & C. Zhai (Eds.), NAACL HLT 2007-human language technologies 2007: The conference of the North American chapter of the association for computational linguistics, proceedings of the main conference (pp. 284-291). Rochester, NY: The Association for Computational Linguistics.
[59] Quené, H.; van den Bergh, H., Examples of mixed-effects modeling with crossed random effects and with binomial data, Journal of Memory and Language, 59, 413-425 (2008)
[60] R Core Team. (2017). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved April 5, 2017 from http://www.R-project.org/.
[61] Richardson, DC; Spivey, MJ; Wnek, G.; Bowlin, G., Eye tracking: Characteristics and methods, Encyclopedia of biomaterials and biomedical engineering, 1028-1042 (2004), Boca Raton: CRC Press, Boca Raton
[62] Riefer, DM; Batchelder, WH, Multinomial modeling and the measurement of cognitive processes, Psychological Review, 95, 318-339 (1988)
[63] Rubin, DB, Inference and missing data, Biometrika, 63, 581-592 (1976) · Zbl 0344.62034
[64] Rubin, RD; Brown-Schmidt, S.; Duff, MC; Tranel, D.; Cohen, NJ, How do I remember that I know you know that I know?, Psychological Science, 22, 1574-1582 (2011)
[65] Ryskin, RA; Benjamin, AS; Tullis, J.; Brown-Schmidt, S., Perspective-taking in comprehension, production, and memory: An individual differences approach, Journal of Experimental Psychology: General, 144, 898-915 (2015)
[66] Salverda, AP; Kleinschmidt, D.; Tanenhaus, MK, Immediate effects of anticipatory coarticulation in spoken-word recognition, Journal of Memory and Language, 71, 145-163 (2014)
[67] Schwarz, G., Estimating the dimension of a model, The Annals of Statistics, 6, 461-464 (1978) · Zbl 0379.62005
[68] Sedivy, JC, Implicature during real time conversation: A view from language processing research, Philosophy Compass, 2, 475-496 (2007)
[69] StataCorp. (2017). Stata statistical software: Release 15. College Station, TX: StataCorp LLC.
[70] Staudte, M.; Crocker, MW, Investigating joint attention mechanisms through spoken human-robot interaction, Cognition, 120, 268-291 (2011)
[71] Tanenhaus, MK; Spivey-Knowlton, MJ; Eberhard, KM; Sedivy, JC, Integration of visual and linguistic information in spoken language comprehension, Science, 268, 1632-1634 (1995)
[72] Tutz, G., Sequential item response models with an ordered response, British Journal of Mathematical and Statistical Psychology, 43, 39-55 (1990) · Zbl 0718.62263
[73] Walker, GM; Hickok, G.; Fridriksson, J., A cognitive psychometric model for assessment of picture naming abilities in aphasia, Psychological Assessment, 30, 809-826 (2018)
[74] Wang, LP; Hamaker, E.; Bergeman, CS, Investigating inter-individual differences in short-term intra-individual variability, Psychological Methods, 17, 567-581 (2012)
[75] West, M.; Harrison, PJ; Migon, HS, Dynamic generalized linear models and Bayesian forecasting, Journal of the American Statistical Association, 80, 73-83 (1985) · Zbl 0568.62032
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.