Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics.

*(English)*Zbl 1063.62563Summary: A new false discovery rate controlling procedure is proposed for multiple hypotheses testing. The procedure makes use of resampling-based \(p\)-value adjustment, and is designed to cope with correlated test statistics. Some properties of the proposed procedure are investigated theoretically, and further properties are investigated using a simulation study. According to the results of the simulation study, the new procedure offers false discovery rate control and greater power. The motivation for developing this resampling-based procedure was an actual problem in meteorology, in which almost 2000 hypotheses are tested simultaneously using highly correlated test statistics. When applied to this problem the increase in power was evident. The same procedure can be used in many other large problems of multiple testing, for example multiple endpoints. The procedure is also extended to serve as a general diagnostic tool in model selection.

##### MSC:

62J15 | Paired and multiple comparisons; multiple testing |

86A10 | Meteorology and atmospheric physics |

PDF
BibTeX
XML
Cite

\textit{D. Yekutieli} and \textit{Y. Benjamini}, J. Stat. Plann. Inference 82, No. 1--2, 171--196 (1999; Zbl 1063.62563)

Full Text:
DOI

##### References:

[1] | Benjamini, Y.; Fuchs, C., Conditional versus unconditional analysis in some regression models., Comm. statist. theory methods, 19, 12, 4731-4756, (1990) |

[2] | Benjamini, Y.; Hochberg, Y., Controlling the false discovery rate: a practical and powerful approach to multiple testing, J. roy. stat. soc. ser. B, 57, 289-300, (1995) · Zbl 0809.62014 |

[3] | Benjamini, Y., Hochberg, Y., Kling, Y., 1995. False discovery rate controlling procedures for pairwise comparisons. Dept. of Statistics and Operations Research Tech 95-2, Tel Aviv University. |

[4] | Benjamini, Y., Yekutieli, D., 1997. The control of the false discovery rate in multiple testing under positive dependency. Dept. of Statistics and Operations Research RS-SOR-97-04, Tel Aviv University. |

[5] | Dunnet, C.W.; Tamhane, A.C., A step-up multiple test procedure, J. amer. statist. assoc., 87, 162-170, (1992) · Zbl 0763.62008 |

[6] | Heyse, J.F.; Rom, D., Adjusting for multiplicity of statistical tests in the analysis of carcinogenicity studies, Biomet. J., 30, 883-896, (1988) |

[7] | Hochberg, Y., Tamhane, A.C., 1987. Multiple Comparison Procedures. Wiley, New York. |

[8] | Manes, A. (Ed.), 1994. Seasonal forecasting of precipitation in Israel. Research Report No. 1, Israeli Meteorological Service, Beit Dagan, April 1994. |

[9] | Shafer, G.; Olkin, I., Adjusting p-values to account for selection over dichotomies, J. amer. statist. assoc., 78, 674-678, (1983) · Zbl 0534.62076 |

[10] | Troendle, J.F., A stepwise resampling method of multiple hypothesis testing, J. amer. statist. assoc., 90, 370-378, (1995) · Zbl 0820.62070 |

[11] | Wassmer, G., Reitmer, P., Kieser, M., Lehmacher, W., 1997. Procedures for testing multiple endpoints in clinical trials: an overview. J. Statist. Plann. Inference 82, 69-81 (this issue). · Zbl 0979.62090 |

[12] | Westfall, P.H.; Young, S.S., p-value adjustment for multiple tests in multivariate binomial models, J. amer. statist. assoc., 84, 780-786, (1989) |

[13] | Westfall, P.H., Young, S.S., 1993. Resampling-Based Multiple Testing. Wiley, New York. |

[14] | Wright, P., Adjusted p-values for simultaneous inference, Biometrics, 48, 1005-1013, (1992) |

[15] | Yekutieli, D., 1996. Resampling-based FDR controlling multiple hypotheses testing. M.Sc. Dissertation, Department of Statistics and Operation Research, Tel Aviv University, Tel Aviv Israel. |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.