Cultural consensus theory for continuous responses: a latent appraisal model for information pooling.

*(English)*Zbl 1309.91108Summary: A Cultural Consensus Theory approach for continuous responses is developed, leading to a new model called the Continuous Response Model (CRM). It is a cognitive psychometric model that is applicable to consensus data, in which respondents (informants) have answered questions (items) regarding a shared knowledge or belief domain, and where a consensus (a latent set of ‘true’ answers applicable to the group) may exist. The model estimates the consensus answers to items, item difficulty, informant knowledge and response biases. The model can handle subcultures that have different consensuses from one another in the data, and can both detect and cluster respondents into these subcultures; it thus provides one of the first forms of model-based clustering for multicultural consensus data of the continuous response type. The model is demonstrated on both simulated and real multi-cultural data, using the hierarchical Bayesian framework for inference; two posterior predictive checks are developed to verify the central assumptions of the model; and software is provided to facilitate the application of the model by other researchers.

##### MSC:

91C20 | Clustering in the social and behavioral sciences |

62P15 | Applications of statistics to psychology |

91E10 | Cognitive psychology |

##### Keywords:

cultural consensus theory; latent class models; latent trait models; continuous data; signal detection theory; mixture modeling; clustering
Full Text:
DOI

##### References:

[1] | Anders, R. (2013). CCTpack: cultural consensus theory applications to data. R package version 0.9. |

[2] | Anders, R.; Batchelder, W. H., Cultural consensus theory for multiple consensus truths, Journal for Mathematical Psychology, 56, 452-469, (2012) |

[3] | Anders, R.; Batchelder, W. H., Cultural consensus theory for the ordinal data case, Psychometrika, (2013) |

[4] | Batchelder, W. H.; Anders, R., Cultural consensus theory: comparing different concepts of cultural truth, Journal of Mathematical Psychology, 56, 316-332, (2012) · Zbl 1282.91293 |

[5] | Batchelder, W. H.; Romney, A. K., The statistical analysis of a general Condorcet model for dichotomous choice situations, (Grofman, B.; Owen, G., Information pooling and group decision making: proceedings of the second University of California Irvine conference on political economy, (1986), JAI Press Greenwich, Conn), 103-112 |

[6] | Batchelder, W. H.; Romney, A. K., Test theory without an answer key, Psychometrika, 53, 71-92, (1988) · Zbl 0718.62260 |

[7] | Batchelder, W. H.; Romney, A. K., New results in test theory without an answer key, (Roskam, Mathematical psychology in progress, (1989), Springer-Verlag Heidelberg, Germany), 229-248 |

[8] | Batchelder, W. H.; Strashny, A.; Romney, A. K., Cultural consensus theory: aggregating continuous responses in a finite interval, (Chai, S. K.; Salerno, J. J.; Mabry, P. L., Social computing, behavioral modeling, and prediction 2010, (2010), Springer-Verlag New York), 98-107 |

[9] | Comrey, A. L., The minimum residual method of factor analysis, Psychological Reports, 11, 15-18, (1962) |

[10] | Fox, C. R.; Tversky, A., Ambiguity aversion and comparative ignorance, The Quarterly Journal of Economics, 110, 585-603, (1995) · Zbl 0836.90004 |

[11] | France, S. L.; Batchelder, W. H., Maximum likelihood item easiness models for test theory without an answer key, Educational and Psychological Measurement, (2014), 0013164414527448 |

[12] | Gelman, A.; Carlin, J. B.; Stern, H. S.; Rubin, D. B., Bayesian data analysis, (2004), Chapman & Hall/CRC Boca Raton, FL · Zbl 1039.62018 |

[13] | Gonzalez, R.; Wu, G., On the shape of the probability weighting function, Cognitive Psychology, 38, 129-166, (1999) |

[14] | Lee, M. D., How cognitive modeling can benefit from hierarchical Bayesian models, Journal of Mathematical Psychology, 55, 1-7, (2011) · Zbl 1208.91123 |

[15] | Lord, F. M.; Novick, M. R.; Birnbaum, A., Statistical theories of mental test scores, Vol. 47, (1968), Addison-Wesley Reading, MA · Zbl 0186.53701 |

[16] | Merkle, E. C.; Steyvers, M., A psychological model for aggregating judgments of magnitude, (Social computing, behavioral-cultural modeling and prediction, (2011), Springer), 236-243 |

[17] | Plummer, M. (2003). JAGS: a program for analysis of Bayesian graphical models using Gibbs sampling. |

[18] | Plummer, M. (2012). Rjags: Bayesian graphic models using mcmc. R package version 3.2.0 (http://CRAN.R-project.org/package=rjags). |

[19] | Rasch, G., Probabilistic models for some intelligence and attainment tests, (1960), Denmarks Paedagogiske Institute Copenhagen |

[20] | Revelle, W., Psych: procedures for psychological, psychometric, and personality research, (2012), Northwestern University Evanston, Illinois, R package version 1.2.1 |

[21] | Romney, A. K.; Weller, S. C.; Batchelder, W. H., Culture as consensus: a theory of culture and informant accuracy, American Anthropologist, 88, 313-338, (1986) |

[22] | Spiegelhalter, D. J.; Best, N. G.; Carlin, B. P.; van der Linde, A., Bayesian measures of model complexity and fit (with discussion), Journal of the Royal Statistical Society, Series B, 6, 583-640, (2002) · Zbl 1067.62010 |

[23] | Stephens, M., Dealing with label switching in mixture models, Journal of the Royal Statistical Society. Series B (Statistical Methodology), 62, 795-809, (2000) · Zbl 0957.62020 |

[24] | Steyvers, M.; Wallsten, T. S.; Merkle, E. C.; Turner, B. M., Evaluating probabilistic forecasts with Bayesian signal detection models, Risk Analysis, (2013) |

[25] | Ter Braak, C. J., A Markov chain Monte Carlo version of the genetic algorithm differential evolution: easy Bayesian computing for real parameter spaces, Statistics and Computing, 16, 3, 239-249, (2006) |

[26] | Thomas, A.; O’Hara, B.; Ligges, U.; Sturtz, S., Making BUGS open, R News, 6, 12-17, (2006) |

[27] | Turner, B., & Steyvers, M. (2011). A wisdom of the crowd approach to forecasting. In 2nd NIPS workshop on computational social science and the wisdom of crowds. |

[28] | Turner, B. M.; Steyvers, M.; Merkle, E. C.; Budescu, D. V.; Wallsten, T. S., Forecast aggregation via recalibration, (Machine learning, (2013)), 1-29 |

[29] | Turner, B. M.; Sederberg, P. B.; Brown, S. D.; Steyvers, M., A method for efficiently sampling from distributions with correlated dimensions, Psychological Methods, 18, 3, 368, (2013) |

[30] | Weller, S. W., Cultural consensus theory: applications and frequently asked questions, Field Methods, 19, 339-368, (2007) |

[31] | Zhang, H.; Maloney, L. T., Ubiquitous log odds: a common representation of probability and frequency distortion in perception, action and cognition, Frontiers in Neuroscience, 6, (2012) |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.