Gibbs, Connor P.; Elmore, Ryan; Fosdick, Bailey K. The causal effect of a timeout at stopping an opposing run in the NBA. (English) Zbl 1498.62346 Ann. Appl. Stat. 16, No. 3, 1359-1379 (2022). Summary: In the summer of 2017, the National Basketball Association reduced the number of total timeouts, along with other rule changes, to regulate the flow of the game. With these rule changes it becomes increasingly important for coaches to effectively manage their timeouts. Understanding the utility of a timeout under various game scenarios, for example, during an opposing team’s run, is of the utmost importance. There are two schools of thought when the opposition is on a run: (1) call a timeout and allow your team to rest and regroup, or (2) save a timeout and hope your team can make corrections during play. This paper investigates the credence of these tenets using the Rubin causal model framework to quantify the causal effect of a timeout in the presence of an opposing team’s run. Too often overlooked, we carefully consider the stable unit-treatment-value assumption (SUTVA) in this context and use the SUTVA to motivate our definition of units. To measure the effect of a timeout, we introduce a novel, interpretable outcome based on the score difference to describe broad changes in the scoring dynamics. This outcome is well suited for situations where the quantity of interest fluctuates frequently, a commonality in many sports analytics applications. We conclude from our analysis that, while comebacks frequently occur after a run, it is slightly disadvantageous to call a timeout during a run by the opposing team and further demonstrate that the magnitude of this effect varies by franchise. Cited in 1 Document MSC: 62P99 Applications of statistics Keywords:causal inference; matching; sports statistics × Cite Format Result Cite Review PDF Full Text: DOI arXiv References: [1] ABADIE, A. (2002). Bootstrap tests for distributional treatment effects in instrumental variable models. J. Amer. Statist. Assoc. 97 284-292. · Zbl 1073.62530 · doi:10.1198/016214502753479419 [2] ABADIE, A., DRUKKER, D., HERR, J. L. and IMBENS, G. W. (2004). Implementing matching estimators for average treatment effects in Stata. Stata J. 4 290-311. [3] ASCHBURNER, S. (2017). NBA changes timeout rules to improve game flow. Available at https://www.nba.com/article/2017/07/12/nba-board-governors-timeout-rules-game-flow-trade-deadline [Accessed: 2020-11-12]. [4] ASSIS, N., ASSUNÇÃO, R. and VAZ-DE-MELO, P. O. (2020). Stop the clock: Are timeout effects real? Preprint. Available at arXiv:2009.06750. [5] AVUGOS, S., KÖPPEN, J., CZIENSKOWSKI, U., RAAB, M. and BAR-ELI, M. (2013). The “hot hand” reconsidered: A meta-analytic approach. Psychol. Sport Exerc. 14 21-27. [6] Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300. · Zbl 0809.62014 [7] BEUOY, M. (2021). Inpredictable: NBA per possession statistics. Available at http://stats.inpredictable.com/nba/ssnTeamPoss.php?season=2018&po=0&frdt=2017-10-17&todt=2019-06-13&view=off [Accessed: 2020-11-12]. [8] BOREN, C. (2019). Raptors’ coach Nick Nurse ripped for timeout that helped the Warriors. Available at https://www.washingtonpost.com/sports/2019/06/11/raptors-coach-nick-nurse-ripped-timeout-that-helped-warriors/ [Accessed: 2020-11-12]. [9] BRESLER, A. (2019). nbastatR: R’s interface to NBA data. R package version 0.1.120301. [10] CURTIS, C. (2019). The NBA rule about timeouts that partially explains Nick Nurse’s weird decision to take one. Available at https://ftw.usatoday.com/2019/06/nba-finals-raptors-nick-nurse-timeout-rule [Accessed: 2020-11-12]. [11] DESHPANDE, S. K. and EVANS, K. (2020). Expected hypothetical completion probability. J. Quant. Anal. Sports 16 85-94. [12] DIAMOND, A. and SEKHON, J. S. (2013). Genetic matching for estimating causal effects: A general multivariate matching method for achieving balance in observational studies. Rev. Econ. Stat. 95 932-945. [13] ESPN (2019). Nick Nurse disrupted Kawhi’s flow, late timeout cost the Raptors in Game 5. Available at https://www.youtube.com/watch?v=UvOvNy-3etc [Accessed: 2020-11-12]. [14] FRANKS, A., MILLER, A., BORNN, L. and GOLDSBERRY, K. (2015). Characterizing the spatial structure of defensive skill in professional basketball. Ann. Appl. Stat. 9 94-121. · Zbl 1454.62538 · doi:10.1214/14-AOAS799 [15] GIBBS, C. P., ELMORE, R. and FOSDICK, B. K. (2022a). Supplement A to “The causal effect of a timeout at stopping an opposing run in the NBA.” https://doi.org/10.1214/21-AOAS1545SUPPA [16] GIBBS, C. P., ELMORE, R. and FOSDICK, B. K. (2022b). Supplement B to “The causal effect of a timeout at stopping an opposing run in the NBA.” https://doi.org/10.1214/21-AOAS1545SUPPB [17] GILOVICH, T., VALLONE, R. and TVERSKY, A. (1985). The hot hand in basketball: On the misperception of random sequences. Cogn. Psychol. 17 295-314. [18] Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive Models. Monographs on Statistics and Applied Probability 43. CRC Press, London. · Zbl 0747.62061 [19] HECKMAN, J. J., ICHIMURA, H. and TODD, P. (1997). Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. Rev. Econ. Stud. 64 605-654. · Zbl 0887.90039 [20] HECKMAN, J. J., ICHIMURA, H. and TODD, P. (1998). Matching as an econometric evaluation estimator. Rev. Econ. Stud. 65 261-294. · Zbl 0908.90059 · doi:10.1111/1467-937X.00044 [21] Imbens, G. W. and Rubin, D. B. (2015). Causal Inference—for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge Univ. Press, New York. · Zbl 1355.62002 · doi:10.1017/CBO9781139025751 [22] KOEHLER, J. J. and CONLEY, C. A. (2003). The “hot hand” myth in professional basketball. J. Sport Exerc. Psychol. 25 253-259. [23] LAULETTA, T. (2019). Nick Nurse called a bizarre timeout late in the fourth quarter that killed the Raptors momentum and sent the Warriors on their game-winning hot streak. Available at https://www.businessinsider.com/nick-nurse-timeout-warriors-hot-streak-raptors-momentum-2019-6/ [Accessed: 2020-11-12]. [24] LIU, W., KURAMOTO, S. J. and STUART, E. A. (2013). An introduction to sensitivity analysis for unobserved confounding in non-experimental prevention research. Prev. Sci. 14 570-580. [25] LOPEZ, M. J. and GUTMAN, R. (2017). Estimation of causal effects with multiple treatments: A review and new ideas. Statist. Sci. 32 432-454. · Zbl 1442.62021 · doi:10.1214/17-STS612 [26] LOPEZ, M. J., MATTHEWS, G. J. and BAUMER, B. S. (2018). How often does the best team win? A unified approach to understanding randomness in North American sport. Ann. Appl. Stat. 12 2483-2516. · Zbl 1412.62216 · doi:10.1214/18-AOAS1165 [27] MILLER, J. B. and SANJURJO, A. (2018). Surprised by the hot hand fallacy? A truth in the law of small numbers. Econometrica 86 2019-2047. · Zbl 1411.91195 · doi:10.3982/ECTA14943 [28] NBA (2020). NBA advanced stats. Available at https://stats.nba.com [Accessed: 2020-11-12]. [29] PERMUTT, S. (2011). The efficacy of momentum-stopping timeouts on short-term performance in the National Basketball Association. Ph.D. thesis. [30] PINA, M. (2019). To call a timeout, or not to call a timeout: That is the question for NBA coaches. Available at https://www.si.com/nba/2019/05/02/steve-kerr-gregg-popovich-mike-dantoni-brad-stevens-brett-brown-nba-coaches-playoffs-timeouts [Accessed: 2020-11-12]. [31] R Core Team (2020). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. [32] ROSENBAUM, P. R. (2007). Sensitivity analysis for \(m\)-estimates, tests, and confidence intervals in matched observational studies. Biometrics 63 456-464. · Zbl 1140.62084 · doi:10.1111/j.1541-0420.2006.00717.x [33] ROSENBAUM, P. R. (2013). Impact of multiple matched controls on design sensitivity in observational studies. Biometrics 69 118-127. · Zbl 1272.62081 · doi:10.1111/j.1541-0420.2012.01821.x [34] ROSENBAUM, P. R. (2015). Two R packages for sensitivity analysis in observational studies. Obs. Stud. 1 1-17. [35] Rosenbaum, P. R. and Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika 70 41-55. · Zbl 0522.62091 · doi:10.1093/biomet/70.1.41 [36] Rosenbaum, P. R. and Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Amer. Statist. 39 33-38. [37] Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol. 66 688-701. [38] Rubin, D. B. (1976). Inference and missing data. Biometrika 63 581-592. · Zbl 0344.62034 · doi:10.1093/biomet/63.3.581 [39] RUBIN, D. B. (1977). Assignment to treatment group on the basis of a covariate. J. Educ. Stat. 2 1-26. [40] SAAVEDRA, S., MUKHERJEE, S. and BAGROW, J. P. (2012). Is coaching experience associated with effective use of timeouts in basketball? Sci. Rep. 2 676. [41] SEKHON, J. S. (2011). Multivariate and propensity score matching software with automated balance optimization: The matching package for R. J. Stat. Softw. 42 1-52. [42] SMITH, J. A. and TODD, P. E. (2005). Does matching overcome LaLonde’s critique of nonexperimental estimators? J. Econometrics 125 305-353. · Zbl 1334.62225 · doi:10.1016/j.jeconom.2004.04.011 [43] Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward. Statist. Sci. 25 1-21. · Zbl 1328.62007 · doi:10.1214/09-STS313 [44] TOUMI, A. and LOPEZ, M. (2019). From grapes and prunes to apples and apples: Using matched methods to estimate optimal zone entry decision-making in the National Hockey League. In Carnegie Mellon Sports Analytics Conference. [45] VOCK, D. M. and VOCK, L. F. B. (2018). Estimating the effect of plate discipline using a causal inference framework: An application of the G-computation algorithm. J. Quant. Anal. Sports 14 37-56. [46] YAM, D. R. and LOPEZ, M. J. (2019). What was lost? A causal estimate of fourth down behavior in the National Football League. J. Sports Anal. 5 153-167. [47] YOUSUF, S. (2018). Rick Carlisle is one of the NBA’s best tacticians. How does he choose when to call a timeout? ‘It’s not a simple answer.’. Available at https://theathletic.com/723304/2018/12/19/rick-carlisle-is-one-of-the-nbas-best-taciticians-how-does-he-choose-when-to-call-a-timeout-its-not-a-simple-answer [Accessed: 2020-11-12]. [48] ZHANG, Z., KIM, H. J., LONJON, G. and ZHU, Y. (2019). Balance diagnostics after propensity score matching. Ann. Transl. Med. 7 16. [49] ZIMMERMAN, D. L., TANG, J. and HUANG, R. (2019). Outline analyses of the called strike zone in Major League Baseball. Ann. Appl. Stat. 13 2416-2451 · Zbl 1435.62445 · doi:10.1214/19-aoas1285 This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.