Shieh, Gwowen Effect size, statistical power, and sample size for assessing interactions between categorical and continuous variables. (English) Zbl 1409.62244 Br. J. Math. Stat. Psychol. 72, No. 1, 136-154 (2019). Summary: The reporting and interpretation of effect size estimates are widely advocated in many academic journals of psychology and related disciplines. However, such concern has not been adequately addressed for analyses involving interactions between categorical and continuous variables. For the purpose of improving current practice, this article presents fundamental features and theoretical developments for the variance of standardized slopes as a desirable standardized effect size measure for the degree of disparity between several slope coefficients. To estimate the effect size, a consistent and nearly unbiased estimator is described and a simple refinement is emphasized for extreme situations whenever appropriate. The essential problems of power and sample size calculations for testing the equality of slope coefficients are also considered. According to the analytic justification and empirical assessment, the exact approach has a clear advantage over the approximate methods. Both SAS and R computer codes are provided to facilitate practical accessibility of the proposed techniques in interaction studies. MSC: 62P15 Applications of statistics to psychology 62D05 Sampling theory, sample surveys Keywords:effect size estimates; psychology; statistical power; sample size Software:Stata; SAS; R PDFBibTeX XMLCite \textit{G. Shieh}, Br. J. Math. Stat. Psychol. 72, No. 1, 136--154 (2019; Zbl 1409.62244) Full Text: DOI References: [1] Aguinis, H. (2004). Regression analysis for categorical moderators. New York: Guilford. [2] Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005). Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30‐year review. {\it Journal of Applied Psychology}, 90, 94-107. https://doi.org/10.1037/0021-9010.90.1.94 [3] Aguinis, H., Boik, R. J., & Pierce, C. A. (2001). A generalized solution for approximating the power to detect effects of categorical moderator variables using multiple regression. {\it Organizational Research Methods}, 4, 291-323. https://doi.org/10.1177/109442810144001 [4] Aguinis, H., & Stone‐Romero, E. F. (1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. {\it Journal of Applied Psychology}, 82, 192-206. https://doi.org/10.1037//0021-9010.82.1.192 [5] Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: Sage. [6] Binkley, J. K., & Abbot, P. C. (1987). The fixed {\it X} assumption in econometrics: Can the textbooks be trusted?{\it American Statistician}, 41, 206-214. https://doi.org/10.2307/2685106 [7] Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. · Zbl 0747.62110 [8] Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum. [9] Cramer, E. M., & Appelbaum, M. I. (1978). The validity of polynomial regression in the random regression model. {\it Review of Educational Research}, 48, 511-515. https://doi.org/10.2307/1170046 [10] Fleishman, A. I. (1980). Confidence intervals for correlation ratios. {\it Educational and Psychological Measurement}, 40, 659-670. https://doi.org/10.1177/001316448004000309 [11] Gatsonis, C., & Sampson, A. R. (1989). Multiple correlation: Exact power and sample size calculations. {\it Psychological Bulletin}, 106, 516-524. https://doi.org/10.1037//0033-2909.106.3.516 [12] Harwell, M. (2003). Summarizing Monte Carlo results in methodological research: The single‐factor, fixed‐effects ANCOVA case. {\it Journal of Educational and Behavioral Statistics}, 28, 45-70. https://doi.org/10.3102/10769986028001045 [13] Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression‐based approach. New York: Guilford. [14] Hayes, A. F., & Matthes, J. (2009). Computational procedures for probing interactions in OLS and logistic regression. {\it Behavior Research Methods}, 41, 924-936. https://doi.org/10.3758/brm.41.3.924 [15] Huitema, B. (2011). The analysis of covariance and alternatives: Statistical methods for experiments, quasi‐experiments, and single‐case studies. Chichester: Wiley. · Zbl 1273.62007 [16] Irwin, J. R., & McClelland, G. H. (2001). Misleading heuristics and moderated multiple regression models. {\it Journal of Marketing Research}, 38, 100-109. https://doi.org/10.1509/jmkr.38.1.100.18835 [17] Jaccard, J., & Turrisi, R. (2003). Interaction effects in multiple regression (2nd ed.). Thousand Oaks, CA: Sage. [18] Johnson, N. L., Kotz, S., & Balakrishnan, N. (1995). Continuous univariate distributions (Vol. 2, 2nd ed.). New York: Wiley. · Zbl 0821.62001 [19] Keppel, G., & Wickens, T. D. (2004). Design and analysis: A researcher’s handbook (4th ed.). Upper Saddle River, NJ: Pearson. [20] Kirk, R. E. (2013). Experimental design: Procedures for the behavioral sciences (4th ed.). Thousand Oaks, CA: Sage. · Zbl 0943.62072 [21] Kutner, M. H., Nachtsheim, C. J., Neter, J., & Li, W. (2005). Applied linear statistical models (5th ed.). New York: McGraw‐Hill. [22] Maxwell, S. E., & Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates. · Zbl 0708.62060 [23] McClelland, G. H., & Judd, C. M. (1993). Statistical difficulties of detecting interactions and moderator effects. {\it Psychological Bulletin}, 114, 376-390. https://doi.org/10.1037//0033-2909.114.2.376 [24] O’Connor, B. P. (2006). Programs for problems created by continuous variable distributions in moderated multiple regression. {\it Organizational Research Methods}, 9, 554-567. https://doi.org/10.1177/1094428106286984 [25] Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (2nd ed.). New York: Holt, Rinehart & Winston. · Zbl 0920.62137 [26] Preacher, K. J., Curran, P. J., & Bauer, D. J. (2006). Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. {\it Journal of Educational and Behavioral Statistics}, 31, 437-448. https://doi.org/10.3102/10769986031004437 [27] Rencher, A. C., & Schaalje, G. B. (2007). Linear models in statistics (2nd ed.). Hoboken, NJ: Wiley. · Zbl 1136.62045 [28] Royston, P., & Sauerbrei, W. (2008). Multivariable model‐building: A pragmatic approach to regression analysis based on fractional polynomials for modelling continuous variables. Chichester: Wiley. · Zbl 1269.62053 [29] Rutherford, A. (2011). ANOVA and ANCOVA: A GLM approach. Hoboken, NJ: Wiley. · Zbl 1268.62069 [30] Sampson, A. R. (1974). A tale of two regressions. {\it Journal of the American Statistical Association}, 69, 682-689. https://doi.org/10.2307/2286002 · Zbl 0291.62081 [31] Sheikh, M. A., Abelsen, B., & Olsen, J. A. (2017). Education and health and well‐being: Direct and indirect effects with multiple mediators and interactions with multiple imputed data in Stata. {\it Journal of Epidemiology and Community Health}, 71, 1037-1045. https://doi.org/10.1136/jech-2016-208671 [32] Shieh, G. (2009). Detecting interaction effects in moderated multiple regression with continuous variables: Power and sample size considerations. {\it Organizational Research Methods}, 12, 510-528. https://doi.org/10.1177/1094428108320370 [33] Stone‐Romero, E. F., Alliger, G. M., & Aguinis, H. (1994). Type II error problems in the use of moderated multiple regression for the detection of moderating effects of dichotomous variables. {\it Journal of Management}, 20, 167-178. https://doi.org/10.1177/014920639402000109 [34] West, S. G., Aiken, L. S., & Krull, J. L. (1996). Experimental personality designs: Analyzing categorical by continuous variable interactions. {\it Journal of Personality}, 64, 1-48. https://doi.org/10.1111/j.1467-6494.1996.tb00813.x [35] Whisman, M. A., & McClelland, G. H. (2005 This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.