×

Calibration of \(\rho \) values for testing precise null hypotheses. (English) Zbl 1182.62053

Summary: \(P\) values are the most commonly used tool to measure evidence against a hypothesis or hypothesized model. Unfortunately, they are often incorrectly viewed as an error probability for rejection of the hypothesis or, even worse, as the posterior probability that the hypothesis is true. The fact that these interpretations can be completely misleading when testing precise hypotheses is first reviewed, through consideration of two revealing simulations. Then two calibrations of a \(\rho \) value are developed, the first being interpretable as odds and the second as either a (conditional) frequentist error probability or as the posterior probability of the hypothesis.

MSC:

62F15 Bayesian inference
62F03 Parametric hypothesis testing
62G10 Nonparametric hypothesis testing
65C60 Computational problems in statistics (MSC2010)
PDFBibTeX XMLCite
Full Text: DOI