×

Small-sample comparisons of confidence intervals for the difference of two independent binomial proportions. (English) Zbl 1446.62101

Summary: This paper compares the exact small-sample achieved coverage and expected lengths of five methods for computing the confidence interval of the difference of two independent binomial proportions. We strongly recommend that one of these be used in practice. The first method we compare is an asymptotic method based on the score statistic (AS) as proposed by O. Miettinen and M. Nurminen [“Comparative analysis of two rates”, Stat. Med. 4, No. 2, 213–226 (1985; doi:10.1002/sim.4780040211)]. R. G. Newcombe [“Interval estimation for the difference between independent proportions: comparison of seven methods”, Stat. Med. 17, No. 8, 873–890 (1998; doi:10.1002/(sici)1097-0258(19980430)17:8<873::aid-sim779>3.0.co;2-i)] has shown that under a certain asymptotic set-up, confidence intervals formed from the score statistic perform better than those formed from the Wald statistic (see also [ C. P. Farrington and G. Manning, “Test statistics and sample size formulae for comparative binomial trials with null hypothesis of non-zero risk difference or non-unity relative risk”, Stat. Med. 9, No. 12, 1447–1454 (1990; doi:10.1002/sim.4780091208)]). The remaining four methods compared are the exact methods of Agresti and Min (AM), Chan and Zhang (CZ), Coe and Tamhane (CT), and Santner and Yamagami (SY). We find that the CT has the best small-sample performance, followed by AM and CZ. Although AS is claimed to perform reasonably well, it performs the worst in this study; about 50% of the time it fails to achieve nominal coverage even with moderately large sample sizes from each binomial treatment.

MSC:

62F25 Parametric tolerance and confidence regions
62-08 Computational methods for problems pertaining to statistics
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Agresti, A.; Caffo, B., Simple and effective confidence intervals for proportions and differences of proportions result from adding two successes and two failures, Amer. Statist., 54, 280-288 (2000) · Zbl 1250.62016
[2] Agresti, A.; Min, Y., On small-sample confidence intervals for parameters in discrete distributions, Biometrics, 57, 963-971 (2001) · Zbl 1209.62041
[3] Blyth, C.; Still, H., Binomial confidence intervals, J. Amer. Statist. Assoc., 78, 108-116 (1983) · Zbl 0503.62028
[4] Brown, L. D.; Cai, T. T.; DasGupta, A., Confidence Intervals for a Binomial Proportion and Asymptotic Expansion, Ann. Statist., 30, 160-201 (2002) · Zbl 1012.62026
[5] Chan, I., Exact tests of equivalence and efficacy with a non-zero lower bound for comparative studies, Statist. Med., 17, 1403-1413 (1998)
[6] Chan, I. S.F.; Zhang, Z., Test-based exact confidence intervals for the difference of two binomial proportions, Biometrics, 55, 1201-1209 (1999) · Zbl 1059.62534
[7] Chen, X., A quasi-exact method for the confidence intervals of the difference of two independent binomial proportions in small sample cases, Statist. Med., 21, 943-956 (2002)
[8] Coe, P. R.; Tamhane, A. C., Small sample confidence intervals for the difference, ratio, and odds ratio of two success probabilities, Comm. Statist. Part B-Simulation Comput., 22, 925-938 (1993) · Zbl 0791.62031
[9] Farrington, C. P.; Manning, G., Test statistics and sample size formulae for comparative binomial trials with null hypothesis of non-zero risk difference or non-unity relative risk, Statist. Med., 9, 1447-1454 (1990)
[10] Katz, D.; Baptista, J.; Azen, S. P.; Pike, M. C., Obtaining confidence intervals for the risk ratio in cohort studies, Biometrics, 34, 469-474 (1978)
[11] Lee, J. J.; Serachitopol, D. M.; Brown, B. W., Likelihood-weighted confidence intervals for the difference of two binomial proportions, Biometrical J., 39, 387-407 (1997) · Zbl 1063.62533
[12] Lee, J. J.; Tu, Z. N., A versatile one-dimensional distribution plot: the BLiP plot, Amer. Statist., 51, 353-358 (1997)
[13] Miettinen, O. S.; Nurminen, M., Comparative analysis of two rates, Statist. Med., 4, 213-226 (1985)
[14] Newcombe, R. G., Interval estimation for the difference between independent proportions: comparison of seven methods, Statist. Med., 17, 873-890 (1998)
[15] Nurminen, M., Analysis of trends in proportions with an ordinally scaled determinant, Biometrical J., 28, 965-974 (1986) · Zbl 0611.62140
[16] Santner, T. J.; Snell, M. K., Small-sample confidence intervals for \(p_1 - p_2\) and \(p_1 / p_2\) in \(2 \times 2\) contingency tables, J. Amer. Statist. Assoc., 75, 386-394 (1980) · Zbl 0458.62025
[17] Santner, T. J.; Yamagami, S., Invariant small sample confidence intervals for the difference of two success probabilities, Comm. Statist. Part B-Simulation Comput., 22, 33-59 (1993) · Zbl 0825.62420
[18] Sun, J.F., Santner, T.J., Venard, C., 2002. An empirical comparison of small sample confidence intervals for \(p_1 - p_2\); Sun, J.F., Santner, T.J., Venard, C., 2002. An empirical comparison of small sample confidence intervals for \(p_1 - p_2\)
[19] Wilson, E. B., Probable inference, the law of succession, and statistical inference, J. Am. Stat. Assoc., 22, 209-212 (1927)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.