zbMATH — the first resource for mathematics

Developing memory-based models of ACT-R within a statistical framework. (English) Zbl 1455.91186
Summary: The ACT-R cognitive architecture is a computational framework for developing, simulating and testing comprehensive theories of cognition. By far, the most common method of evaluating ACT-R models involves generating predictions through Monte Carlo simulation and comparing those predictions to aggregated human data. This approach has several limitations, including computational inefficiency, the potential for averaging artifacts, and difficulty representing uncertainty in parameter estimates. In this paper, we demonstrate the fundamentals of developing models of ACT-R within a Bayesian framework. Instantiating ACT-R in a Bayesian framework has many advantages, including the ability to use modern parameter estimation and model comparison techniques, the ability to compare ACT-R to other closed-form models, increased computational efficiency, and the ability to perform a deeper mathematical analysis of model properties. We develop model variants of the classic fan experiment, beginning with a simple baseline model of ACT-R’s declarative memory system and progressing through increasingly complex variants until reaching a moderately complex general model. Our hope is that this will highlight connections between computational and mathematical approaches to formal modeling and facilitate new and exciting research.
91E10 Cognitive psychology
91E40 Memory and learning in psychology
62P15 Applications of statistics to psychology
62F15 Bayesian inference
Full Text: DOI
[1] ACT-R Software, Lisp ACT-R tutorial (2019), URL http://act-r.psy.cmu.edu/software/
[2] Anderson, J. R., Retrieval of propositional information from long-term memory, Cognitive Psychology, 6, 4, 451-474 (1974)
[3] Anderson, J. R., How can the human mind occur in the physical universe? (2007), Oxford University Press
[4] Anderson, J. R.; Bothell, D.; Byrne, M. D.; Douglass, S.; Lebiere, C.; Qin, Y., An integrated theory of the mind, Psychological Review, 111, 4, 1036-1060 (2004)
[5] Anderson, J. R.; Bothell, D.; Douglass, S., Eye movements do not reflect retrieval processes: Limits of the eye-mind hypothesis, Psychological Science, 15, 4, 225-231 (2004)
[6] Anderson, J. R.; Bothell, D.; Lebiere, C.; Matessa, M., An integrated theory of list memory, Journal of Memory and Language, 38, 4, 341-380 (1998)
[7] Anderson, J. R.; Qin, Y.; Stenger, V. A.; Carter, C. S., The relationship of three cortical regions to an information-processing model, Journal of Cognitive Neuroscience, 16, 4, 637-653 (2004)
[8] Bezanson, J.; Edelman, A.; Karpinski, S.; Shah, V. B., Julia: A fresh approach to numerical computing, SIAM Review, 59, 1, 65-98 (2017) · Zbl 1356.68030
[9] Brown, S.; Heathcote, A., Averaging learning curves across and within participants, Behavior Research Methods, Instruments, & Computers, 35, 1, 11-21 (2003)
[10] Busemeyer, J. R.; Pothos, E. M.; Franco, R.; Trueblood, J. S., A quantum theoretical explanation for probability judgment errors, Psychological Review, 118, 2, 193-218 (2011)
[11] Busemeyer, J. R.; Townsend, J. T., Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment, Psychological Review, 100, 3, 432 (1993)
[12] Carpenter, B.; Gelman, A.; Hoffman, M. D.; Lee, D.; Goodrich, B.; Betancourt, M., Stan: A probabilistic programming language, Journal of Statistical Software, 76, 1 (2017)
[13] Estes, W. K., The problem of inference from curves based on group data, Psychological Bulletin, 53, 2, 134-140 (1956)
[14] Fisher, C. R.; Houpt, J.; Gunzelmann, G., A comparison of approximations for base-level activation in ACT-r, Computational Brain & Behavior, 1-9 (2018)
[15] Ge, H.; Xu, K.; Ghahramani, Z., Turing: Composable inference for probabilistic programming, (Storkey, A. J.; Pérez-Cruz, F., International Conference on Artificial Intelligence and Statistics. International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, vol. 84 (2018), PMLR), 1682-1690, URL http://proceedings.mlr.press/v84/ge18b.html
[16] Gelman, A.; Carlin, J. B.; Stern, H. S.; Dunson, D. B.; Vehtari, A.; Rubin, D. B., Bayesian data analysis (2013), Boca Raton: Chapman & Hall
[17] Gelman, A.; Shalizi, C. R., Philosophy and the practice of Bayesian statistics, British Journal of Mathematical and Statistical Psychology, 66, 1, 8-38 (2013) · Zbl 1410.62009
[18] Gluck, K.; Bello, P.; Busemeyer, J., Introduction to the special issue, Cognitive Science, 32, 8, 1245-1247 (2008)
[19] Gunzelmann, G.; Gross, J. B.; Gluck, K. A.; Dinges, D. F., Sleep deprivation and sustained attention performance: Integrating mathematical and cognitive modeling, Cognitive Science, 33, 5, 880-910 (2009)
[20] Harris, J. 2008. MindModeling@Home: A large-scale computational cognitive modeling infrastructure. In Proceedings of the 6th annual conference on systems engineering research.
[21] Hoffman, M. D.; Gelman, A., The No-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo, Journal of Machine Learning Research (JMLR), 15, 1, 1593-1623 (2014) · Zbl 1319.60150
[22] Kieras, D. E.; Meyer, D. E., An overview of the EPIC architecture for cognition and performance with application to human-computer interaction, Human-Computer Interaction, 12, 4, 391-438 (1997)
[23] Kruschke, J. K., Bayesian assessment of null values via parameter estimation and model comparison, Perspectives on Psychological Science, 6, 3, 299-312 (2011)
[24] Kruschke, J. K., Posterior predictive checks can and should be Bayesian: Comment on Gelman and Shalizi,‘Philosophy and the practice of Bayesian statistics’, British Journal of Mathematical and Statistical Psychology, 66, 1, 45-56 (2013) · Zbl 1410.62011
[25] Kruschke, J. K.; Liddell, T. M., The Bayesian new statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective, Psychonomic Bulletin & Review, 25, 1, 178 (2018)
[26] Lebiere, C., The dynamics of cognition: An ACT-R model of cognitive arithmetic, Kognitionswissenschaft, 8, 1, 5-19 (1999)
[27] Lebière, C.; Anderson, J. R.; Reder, L. M., Error modeling in the ACT-R production system, (Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society (1994), Erlbaum Hillsdale, NJ), 555-559
[28] Lin, Y.-S.; Heathcote, A.; Holmes, W. R., Parallel probability density approximation, Behavior Research Methods, 51, 6, 2777-2799 (2019)
[29] Montenegro, M.; Myung, J. I.; Pitt, M. A., Analytical expressions for the REM model of recognition memory, Journal Of Mathematical Psychology, 60, 23-28 (2014) · Zbl 1304.91173
[30] Newell, A., Unified theories of cognition (1990), Harvard University Press
[31] Nicenboim, B.; Vasishth, S., Models of retrieval in sentence comprehension: A computational evaluation using Bayesian hierarchical modeling, Journal of Memory and Language, 99, 1-34 (2018)
[32] Nosofsky, R. M., Attention, similarity, and the identification-categorization relationship, Journal of Experimental Psychology: General, 115, 1, 39-57 (1986)
[33] Petrov, A. A. 2006. Computationally efficient approximation of the base-level learning equation in ACT-R. In Proceedings of the seventh international conference on cognitive modeling (pp. 391-392).
[34] Ratcliff, R., A theory of memory retrieval, Psychological Review, 85, 2, 59-108 (1978)
[35] Ratcliff, R.; Rouder, J. N., Modeling response times for two-choice decisions, Psychological Science, 9, 5, 347-356 (1998)
[36] Ratcliff, R.; Thapar, A.; McKoon, G., A diffusion model analysis of the effects of aging on recognition memory, Journal of Memory and Language, 50, 4, 408-424 (2004)
[37] Ross, S. M., Stochastic processes (1996), Wiley: Wiley New York · Zbl 0888.60002
[38] Rouder, J. N.; Province, J. M.; Morey, R. D.; Gomez, P.; Heathcote, A., The lognormal race: A cognitive-process model of choice and latency with desirable psychometric properties, Psychometrika, 80, 2, 491-513 (2015) · Zbl 1322.62339
[39] Salvatier, J.; Wiecki, T. V.; Fonnesbeck, C., Probabilistic programming in Python using PyMC3, PeerJ Comput. Sci., 2, e55 (2016)
[40] Siegler, R. S., The perils of averaging data over strategies: An example from children’s addition, Journal of Experimental Psychology: General, 116, 3, 250-264 (1987)
[41] Sun, R., The importance of cognitive architectures: An analysis based on CLARION, Journal of Experimental & Theoretical Artificial Intelligence, 19, 2, 159-193 (2007)
[42] Townsend, J. T.; Nozawa, G., Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories, Journal of Mathematical Psychology, 39, 4, 321-359 (1995) · Zbl 0865.92029
[43] Turner, B. M.; Sederberg, P. B., A generalized, likelihood-free method for posterior estimation, Psychonomic Bulletin & Review, 21, 2, 227-250 (2014)
[44] Turner, B. M.; Van Zandt, T., A tutorial on approximate Bayesian computation, Journal of Mathematical Psychology, 56, 2, 69-85 (2012) · Zbl 1245.91084
[45] Weaver, R., Parameters, predictions, and evidence in computational modeling: A statistical view informed by ACT-R, Cognitive Science, 32, 8, 1349-1375 (2008)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.