×
Fusejima, Koki; Ishihara, Takuya; Sawada, Masayuki

A unified test for regression discontinuity designs. (English) Zbl 08092420

J. Econom. 251, Article ID 106074, 17 p. (2025).
Summary: Diagnostic tests for regression discontinuity design face a size-control problem. We document a massive over-rejection of the diagnostic restriction among empirical studies in the top five economics journals. At least one diagnostic test was rejected for 19 out of 59 studies, whereas less than 5% of the collected 787 tests rejected the . In other words, one-third of the studies rejected at least one of their diagnostic tests, whereas their underlying identifying restrictions appear plausible. Multiple testing causes this problem because the median number of tests per study was as high as 12. The critical issue is the lack of a formal method to dismiss possibly false rejections caused by the multiple testing problem. Therefore, we offer unified tests to overcome the size-control problem. Our procedure is based on the new joint asymptotic normality of local polynomial mean and density estimates. In simulation studies, our unified tests outperformed the . We implement the procedure as an R package rdtest with two empirical examples in its vignettes.
© The Authors

MSC:

62-XX Statistics
91-XX Game theory, economics, finance, and other social and behavioral sciences

Keywords:

regression discontinuity designs; diagnostic test; nonparametric estimation; multiple testing

Software:

RWOLF; rdrobust; rdtest; R; rdlocrand; rddensity; rdbwdensity
Cite Review PDF
Full Text: DOI arXiv

References:

[1] Abdulkadiroğlu, A.; Angrist, J.; Pathak, P., The Elite Illusion: Achievement Effects at Boston and New York Exam Schools, Econometrica, 82, 1, 137-196, 2014
[2] Asher, S.; Novosad, P., Rural roads and local economic development, Am. Econ. Rev., 110, 3, 797-823, 2020
[3] Bertanha, M.; Imbens, G. W., External validity in fuzzy regression discontinuity designs, J. Bus. Econom. Statist., 38, 3, 593-612, 2020 · Zbl 1547.62619
[4] Bugni, F. A.; Canay, I. A., Testing continuity of a density via g-order statistics in the regression discontinuity design, J. Econometrics, 221, 1, 138-159, 2020 · Zbl 1464.62270
[5] Calonico, S.; Cattaneo, M. D.; Farrell, M. H., Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs, Econom. J., 23, 2, 192-210, 2020 · Zbl 07546364
[6] Calonico, S.; Cattaneo, M. D.; Farrell, M. H., Coverage error optimal confidence intervals for local polynomial regression, Bernoulli, 28, 4, 2998-3022, 2022 · Zbl 07594086
[7] Calonico, S.; Cattaneo, M. D.; Farrell, M. H.; Titiunik, R., Rdrobust: Software for regression-discontinuity designs, Stata J., 17, 2, 372-404, 2017
[8] Calonico, S.; Cattaneo, M. D.; Titiunik, R., Robust nonparametric confidence intervals for regression-discontinuity designs, Econometrica, 82, 6, 2295-2326, 2014 · Zbl 1410.62066
[9] Calonico, S.; Cattaneo, M. D.; Titiunik, R., Optimal data-driven regression discontinuity plots, J. Amer. Statist. Assoc., 110, 512, 1753-1769, 2015 · Zbl 1373.62569
[10] Canay, I. A.; Kamat, V., Approximate permutation tests and induced order statistics in the regression discontinuity design, Rev. Econ. Stud., 85, 3, 1577-1608, 2018 · Zbl 1409.62095
[11] Cattaneo, M. D.; Frandsen, B. R.; Titiunik, R., Randomization inference in the regression discontinuity design: An application to party advantages in the U.S. Senate, J. Causal Inference, 3, 1, 1-24, 2015
[12] Cattaneo, M. D.; Idrobo, N.; Titiunik, R., A Practical Introduction to Regression Discontinuity Designs: Foundations, 2019, Cambridge University Press
[13] Cattaneo, M. D.; Idrobo, N.; Titiunik, R., A Practical Introduction to Regression Discontinuity Designs: Extensions, 2024, Cambridge University Press
[14] Cattaneo, M. D.; Jansson, M.; Ma, X., Manipulation testing based on density discontinuity, Stata J., 18, 1, 234-261, 2018
[15] Cattaneo, M. D.; Jansson, M.; Ma, X., Simple local polynomial density estimators, J. Amer. Statist. Assoc., 115, 531, 1449-1455, 2020 · Zbl 1441.62091
[16] Cattaneo, M. D.; Titiunik, R., Regression Discontinuity Designs, Annu. Rev. Econ., 14, Volume 14, 2022, 821-851, 2022
[17] Cattaneo, M. D.; Titiunik, R.; Vazquez-Bare, G., Inference in regression discontinuity designs under local randomization, Stata J., 16, 2, 331-367, 2016
[18] Cattaneo, M. D.; Titiunik, R.; Vazquez-Bare, G., Comparing Inference Approaches for RD Designs: A Reexamination of the Effect of Head Start on Child Mortality, J. Policy Anal. Manag., 36, 3, 643-681, 2017
[19] Clarke, D., Rwolf2 Implementation and Flexible Syntax, Mimeo, 2021
[20] Fan, J.; Gijbels, I., Local Polynomial Modelling and its Applications: Monographs on Statistics and Applied Probability 66, Vol. 66, 1996, CRC Press · Zbl 0873.62037
[21] Fort, M.; Ichino, A.; Zanella, G., Cognitive and noncognitive costs of day care at age 0–2 for children in advantaged families, J. Political Econ., 128, 1, 158-205, 2020
[22] Hahn, J.; Todd, P.; van der Klaauw, W., Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design, Econometrica, 69, 1, 201-209, 2001
[23] Hartman, E., Equivalence testing for regression discontinuity designs, Political Anal., 29, 4, 505-521, 2021
[24] Hartman, E.; Hidalgo, F. D., An equivalence approach to balance and placebo tests, Am. J. Political Sci., 62, 4, 1000-1013, 2018
[25] Hsu, Y.-C.; Shen, S., Testing treatment effect heterogeneity in regression discontinuity designs, J. Econometrics, 208, 2, 468-486, 2019 · Zbl 1452.62920
[26] Hsu, Y.-C.; Shen, S., Testing monotonicity of conditional treatment effects under regression discontinuity designs, J. Appl. Econometrics, 36, 3, 346-366, 2021
[27] Hyytinen, A.; Meriläinen, J.; Saarimaa, T.; Toivanen, O.; Tukiainen, J., When does regression discontinuity design work? Evidence from random election outcomes, Quant. Econ., 9, 2, 1019-1051, 2018 · Zbl 1396.62284
[28] Ishihara, T.; Sawada, M., Manipulation-robust regression discontinuity designs, 2023, arXiv:2009.07551 [Econ, Stat]
[29] Jäger, S.; Schoefer, B.; Heining, J., Labor in the Boardroom*, Q. J. Econ., 136, 2, 669-725, 2021 · Zbl 1467.91071
[30] Johnson, M. S., Regulation by Shaming: Deterrence Effects of Publicizing Violations of Workplace Safety and Health Laws, Am. Econ. Rev., 110, 6, 1866-1904, 2020
[31] Korting, C.; Lieberman, C.; Matsudaira, J.; Pei, Z.; Shen, Y., Visual inference and graphical representation in regression discontinuity designs, Q. J. Econ., 138, 3, 1977-2019, 2023 · Zbl 07738826
[32] Lee, D. S., Randomized experiments from non-random selection in U.S. House elections, J. Econometrics, 142, 2, 675-697, 2008 · Zbl 1418.62500
[33] Lee, D. S.; Lemieux, T., Regression discontinuity designs in economics, J. Econ. Lit., 48, 2, 281-355, 2010
[34] McCrary, J., Manipulation of the running variable in the regression discontinuity design: A density test, J. Econometrics, 142, 2, 698-714, 2008 · Zbl 1418.62142
[35] Meyersson, E., Islamic Rule and the Empowerment of the Poor and Pious, Econometrica, 82, 1, 229-269, 2014
[36] Montiel Olea, J. L.; Plagborg-Møller, M., Simultaneous confidence bands: Theory, implementation, and an application to SVARs, J. Appl. Econometrics, 34, 1, 1-17, 2019
[37] Otsu, T.; Xu, K.-L.; Matsushita, Y., Estimation and inference of discontinuity in density, J. Bus. Econom. Statist., 31, 4, 507-524, 2013 · Zbl 1553.62020
[38] Pons, V.; Tricaud, C., Expressive voting and its cost: Evidence from runoffs with two or three candidates, Econometrica, 86, 5, 1621-1649, 2018 · Zbl 1419.91259
[39] Romano, J. P.; Wolf, M., Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing, J. Amer. Statist. Assoc., 100, 469, 94-108, 2005 · Zbl 1117.62416
[40] Romano, J. P.; Wolf, M., Efficient computation of adjusted p-values for resampling-based stepdown multiple testing, Statist. Probab. Lett., 113, 38-40, 2016 · Zbl 1384.62056
[41] Roth, J., Pretest with caution: Event-study estimates after testing for parallel trends, Am. Econ. Rev.: Insights, 4, 3, 305-322, 2022
[42] Tyrefors Hinnerich, B.; Pettersson-Lidbom, P., Democracy, redistribution, and political participation: Evidence from Sweden 1919–1938, Econometrica, 82, 3, 961-993, 2014
[43] Wellek, S., Testing Statistical Hypotheses of Equivalence and Noninferiority, 2010, Chapman and Hall/CRC · Zbl 1219.62002
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.