×

zbMATH — the first resource for mathematics

New estimation approaches for the hierarchical linear ballistic accumulator model. (English) Zbl 1442.91025
Summary: The linear ballistic accumulator (LBA: [the last author and A. Heathcote, “The simplest complete model of choice response time: linear ballistic accumulation”, Cognitive Psychol. 57, No. 3, 153–178 (2008; doi:10.1016/j.cogpsych.2007.12.002)]) model is used as a measurement tool to answer questions about applied psychology. The analyses based on this model depend upon the model selected and its estimated parameters. Modern approaches use hierarchical Bayesian models and Markov chain Monte-Carlo (MCMC) methods to estimate the posterior distribution of the parameters. Although there are several approaches available for model selection, they are all based on the posterior samples produced via MCMC, which means that the model selection inference inherits the properties of the MCMC sampler. To improve on current approaches to LBA inference we propose two methods that are based on recent advances in particle MCMC methodology; they are qualitatively different from existing approaches as well as from each other. The first approach is particle Metropolis-within-Gibbs; the second approach is density tempered sequential Monte Carlo. Both new approaches provide very efficient sampling and can be applied to estimate the marginal likelihood, which provides Bayes factors for model selection. The first approach is usually faster. The second approach provides a direct estimate of the marginal likelihood, uses the first approach in its Markov move step and is very efficient to parallelise on high performance computers. The new methods are illustrated by applying them to simulated and real data, and through pseudo code. The code implementing the methods is freely available.
MSC:
91B06 Decision theory
91E45 Measurement and performance in psychology
Software:
CODA
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Annis, J.; Miller, B. J.; Palmeri, T. J., Bayesian inference with Stan: a tutorial on adding custom distributions, Behavioural Research, 49, 863-886 (2017)
[2] Atkinson, K.; Han, W., Elementary numerical analysis (2004), John Wiley: John Wiley New York
[3] Betancourt, M., A conceptual introduction to Hamiltonian Monte Carlo (2018), arXiv:1701.02434v2
[4] Brown, S.; Heathcote, A., A Ballistic model of choice response time, Psychological Review, 112, 117-128 (2005)
[5] Brown, S.; Heathcote, A., The simple complete model of choice reaction time: Linear Ballistic accumulation, Cognitive Psychology, 57, 153-178 (2008)
[6] Chib, S.; Greenberg, E., Markov chain Monte Carlo simulation methods in econometrics, Econometrics Theory, 12, 409-431 (1996)
[7] Chib, S.; Jeliazkov, I., Marginal likelihood from the Metropolis-Hastings output, Journal of the American Statistical Association, 96, 453, 270-281 (2001) · Zbl 1015.62020
[8] Del Moral, P.; Doucet, A.; Jasra, A., Sequential Monte Carlo samplers, Journal of the Royal Statistical Society. Series B., 68, 411-436 (2006) · Zbl 1105.62034
[9] Del Moral, P.; Doucet, A.; Jasra, A., An adaptive Sequential Monte Carlo for approximate Bayesian computation, Statistics and Computing, 1009-1020 (2012) · Zbl 1252.65025
[10] Donkin, C.; Brown, S. D., Response times and decision-making, (Stevens’ handbook of experimental psychology and cognitive neuroscience, methodology (2018), John Wiley & Sons), 349
[11] Donkin, C.; Brown, S. D.; Heathcote, A. J., The over-constraint of response time models: Rethinking the scaling problem, Psychonomic Bulletin & Review, 16, 1129-1135 (2009)
[12] Duan, J. C.; Fulop, A., Density-tempered marginalised sequential Monte Carlo samplers, Journal of Business & Economic Statistics, 33, 2, 192-202 (2015)
[13] Evans, N. J.; Annis, J., Thermodynamic integration via differential evolution: a method for estimating marginal likelihood, Behavior Research Methods, 51, 930-947 (2019)
[14] Evans, N. J.; Brown, S. D., Bayes factors for the linear Ballistic accumulator model of decision-making, Behavior Research Methods, 50, 2, 589-603 (2018)
[15] Evans, N. J.; Steyvers, M.; Brown, S. D., Modeling the covariance structure of complex datasets using cognitive models: An application to individual differences and the heritability of cognitive ability, Cognitive Science, 42, 6, 1925-1944 (2018)
[16] Forstmann, B. U.; Dutilh, G.; Brown, S.; Neumann, J.; von Cramon, D. Y., Striatum and pre-SMA facilitate decision making under time pressure, Proceedings of the National Academy of Sciences, 105, 17538-17542 (2008)
[17] Friel, N.; Hurn, M.; Wyse, J., Improving power posterior estimation of statistical evidence, Statistics and Computing, 24, 5, 709-723 (2014) · Zbl 1322.62098
[18] Friel, N.; Pettitt, A. N., Marginal likelihood estimation via power posteriors, Journal of the Royal Statistical Society. Series B. Statistical Methodology, 70, 3, 589-607 (2008) · Zbl 05563360
[19] Gelman, A.; Meng, X.-L., Simulating normalizing constants: From importance sampling to bridge sampling to path sampling, Statistical Science, 163-185 (1998) · Zbl 0966.65004
[20] Gronau, Q. F.; Heathcote, A.; Matzke, D., Computing Bayes factors for evidence accumulation models using warp-III bridge sampling, Behavior Research Methods (2019)
[21] Gunawan, D.; Carter, C.; Fiebig, D. G.; Kohn, R., Efficient Bayesian estimation for flexible panel models for multivariate outcomes: impact of life events on mental health and excessive alcohol consumption (2017), arXiv preprint arXiv:1706.03953v1
[22] Gunawan, D.; Hawkins, G. E.; Kohn, R.; Tran, M. N.; Brown, S. D., Time-evolving psychological processes over repeated decisions (2019), arXiv:1906.10838v1
[23] Hesterberg, T., Weighted average importance sampling and defensive mixture distributions, Technometrics, 37, 185-194 (1995) · Zbl 0822.62002
[24] Huang, A.; Wand, M. P., Simple marginally noninformative prior distributions for covariance matrices, Bayesian Analysis, 8, 2, 439-452 (2013) · Zbl 1329.62135
[25] Kass, R. E.; Raftery, A. E., Bayes factors, Journal of the American Statistical Association, 90, 430, 773-795 (1995) · Zbl 0846.62028
[26] Neal, R., Annealed importance sampling, Statistics and Computing, 11, 125-139 (2001)
[27] Plummer, M.; Best, N.; Cowles, K.; Vines, K., CODA: Convergence diagnosis and output analysis of MCMC, R News, 6, 1, 7-11 (2006)
[28] Ratcliff, R., A theory of memory retrieval, Psychological Review, 85, 59-108 (1978)
[29] Ratcliff, R.; Rouder, J. N., Modeling response times for two-choice decisions, Psychological Science, 9, 347-356 (1998)
[30] Ratcliff, R.; Smith, P. L., A comparison of sequential sampling models for two-choice reaction time, Psychological Review, 111, 333-367 (2004)
[31] Ratcliff, R.; Smith, P. L.; Brown, S. D.; McKoon, G., Diffusion decision model: current issues and history, Trends in Cognitive Sciences, 20, 4, 260-281 (2016)
[32] Spiegelhalter, D. J.; Best, N. G.; Carlin, B. P.; Linde, A., The deviance information criterion: 12 years on, Journal of the Royal Statistical Society. Series B. Statistical Methodology, 76, 3, 485-493 (2014) · Zbl 1411.62027
[33] Terry, A.; Marley, A.; Barnwal, A.; Wagenmakers, E.-J.; Heathcote, A.; Brown, S. D., Generalising the drift rate distribution for linear Ballistic accumulators, Journal of Mathematical Psychology, 68, 49-58 (2015) · Zbl 1354.91044
[34] Turner, B. M.; Sederberg, P. B.; Brown, S. D.; Steyvers, M., A method for efficiently sampling from distributions with correlated dimensions, Psychological Methods, 18, 3, 368-384 (2013)
[35] Usher, M.; McClelland, J. L., On the time course of perceptual choice: The leaky competing accumulator model, Psychological Review, 108, 550-592 (2001)
[36] Wall, L.; Gunawan, D.; Brown, S. D.; Tran, M. N.; Kohn, R.; Hawkins, G. E., Identifying relationships between cognitive processes across tasks, contexts, and time (2019), arXiv:1910.07185v1
[37] Watanabe, S., Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory, Journal of Machine Learning Research (JMLR), 11, Dec, 3571-3594 (2010) · Zbl 1242.62024
[38] Xie, W.; Lewis, P. O.; Fan, Y.; Kuo, L.; Chen, M. H., Improving marginal likelihood estimation for Bayesian phylogenetic model selection, Systematic Biology, 60, 2, 150-160 (2010)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.