Summary: Consider an experiment yielding an observable random quantity whose distribution is indexed by a real parameter . Suppose that a statistician is prepared to execute a Bayes procedure in estimating and has quantified available prior information about in his chosen prior distribution . Suppose that before this estimation process is completed, the statistician becomes aware of the outcome of a “similar” experiment. We investigate the questions of whether, and when, this additional information can be exploited so as to provide a better estimate of in the “current” experiment.
We show that in the traditional empirical Bayes framework and in situations involving exponential families, conjugate priors, and squared error loss, the answer is “essentially always.” An explicit Bayes empirical Bayes (BEB) estimator of is given that is superior to the original Bayes estimator, showing that the statistician has, in these problems, the opportunity to be a “better Bayesian” by combining some relevant empirical findings with the subjective information embodied in the prior . Our results answer a question in a Bayesian context that remains exclusive in the classical, non-Bayesian version of empirical Bayes estimation. In the final section, our BEB estimator is shown to compare favorably to two other BEB estimators suggested in the literature.