Construction of an informative hierarchical prior for a small sample with the help of historical data and application to electricity load forecasting. (English) Zbl 1328.62174

Summary: We are interested in the estimation and prediction of a parametric model on a short dataset upon which it is expected to overfit and perform badly. To overcome the lack of data (relatively to the dimension of the model), we propose the construction of an informative hierarchical Bayesian prior based on another longer dataset which is assumed to share some similarities with the original, short dataset. We illustrate the performance of our prior on simulated datasets from two standard models. We then apply the methodology to a working model for the electricity load forecasting on real datasets, where it leads to a substantial improvement of the quality of the predictions.


62F15 Bayesian inference
62J02 General nonlinear regression
62P30 Applications of statistics in engineering and industry; control charts
Full Text: DOI arXiv


[1] Abramovitz M, Stegun I (1965) Handbook of mathematical functions with formulas, graphs, and mathematical tables. Dover Publications, New York
[2] Al-Zayer, J; Al-Ibrahim, A, Modelling the impact of temperature on electricity consumption in the eastern province of saudi arabia, J Forecast, 15, 97-106, (1996)
[3] Albert J (2009) Bayesian computation with R. Springer, Dordrecht · Zbl 1165.62022
[4] Berger J (1985) Statistical decision theory and Bayesian analysis. Springer series in statistics. Springer, New York · Zbl 1097.91541
[5] Berger, J; Bernardo, J, On the development of the reference prior method, Bayesian Stat, 4, 35-60, (1992)
[6] Bernardo JM (1979) Reference posterior distributions for Bayesian inference. J R Stat Soc Ser B 41(2):113-147 · Zbl 0428.62004
[7] Bouveyron C, Jacques J (2013) Adaptive mixtures of regressions: improving predictive inference when population has changed. Commun Stat: Simul Comput (to appear) · Zbl 1462.62409
[8] Bruhns A, Deurveilher G, Roy J (2005) A non-linear regression model for mid-term load forecasting and improvements in seasonnality. In: Proceedings of the 15th power systems computation conference, Liege, Belgium
[9] Bunn D, Farmer E (1985) Comparative models for electrical load forecasting. Wiley, New York
[10] Cam L, Yang G (2000) Asymptotics in statistics: some basic concepts. Springer series in statistics. Springer, New York · Zbl 0952.62002
[11] Congdon P (2010) Applied Bayesian hierarchical methods. Chapman & Hall, CRC, New York · Zbl 1216.62036
[12] Cottet, R; Smith, M, Bayesian modeling and forecasting of intraday electricity load, J Am Stat Assoc, 98, 839-849, (2003)
[13] Cugliari J (2011) Prévision non paramétrique de processus à valeurs fonctionnelles, application à la consommation d’électricité. PhD thesis, Univérsité Paris Sud XI
[14] Dordonnat, V; Koopman, S; Ooms, M; Dessertaine, A; Collet, J, An hourly periodic state space model for modelling French national electricity load, Int J Forecast, 24, 566-587, (2008)
[15] Efron B (2010) Large-scale inference: empirical Bayes methods for estimation, testing, and prediction. Institute of Mathematical Statistics Monographs, Cambridge University Press, Cambridge · Zbl 1277.62016
[16] Engle, R; Granger, C; Rice, J; Weiss, A, Semiparametric estimates of the relation between weather and electricity, J Am Stat Assoc, 81, 310-320, (1986)
[17] Fan J, Yao Q (2005) Non linear time series: nonparametric and parametric methods. Springer, New York
[18] Gelman A, Hill J (2007) Data analysis using regression and multilevel/hierarchical models. Cambridge University Press, Cambridge
[19] Gelman A, Carlin J, Stern H, Dunson D, Vehtari A, Rubin D (2013) Bayesian data analysis. Chapman & Hall CRC Texts in Statistical Science, New York · Zbl 1279.62004
[20] Ghosh JK, Delampady M, Samanta T (2006) An introduction to Bayesian analysis: theory and methods. Springer, New York · Zbl 1135.62002
[21] Harrison, P; Stevens, C, Bayesian forecasting, J R Stat Soc, 38, 205-247, (1976) · Zbl 0349.62062
[22] Hyndman RJ, Khandakar Y (2008) Automatic time series forecasting: the forecast package for R. J Stat Softw 88(3)
[23] Launay T (2012) Bayesian methods for electricity load forecasting. PhD thesis, Université de Nantes
[24] Launay, T; Philippe, A; Lamarche, S, Consistency of the posterior distribution and MLE for piecewise linear regression, Electron J Stat, 6, 1307-1357, (2012) · Zbl 1336.62089
[25] Marin JM, Robert C (2014) Bayesian essentials with R, 2nd edn. Springer texts in statistics, Springer, New York · Zbl 1380.62005
[26] Menage JP, Panciatici P, Boury F (1988) Nouvelle modelisation de l’influence des conditions climatiques sur la consommation d’energie electrique. Tech. rep., EDF R&D
[27] Minka TP (1999) Bayesian linear regression. Tech. rep., 3594 Security Ticket Control
[28] Ramanathan, R; Engle, R; Granger, C; Vahid-Araghi, F; Brace, C, Short-run forecasts of electricity loads and peaks, Int J Forecast, 13, 161-174, (1997)
[29] Robert CP (2007) The Bayesian choice: from decision-theoretic foundations to computational implementation, 2nd edn. Springer, New York · Zbl 1129.62003
[30] Robert CP, Casella G (2009) Introducing Monte Carlo methods with R, 1st edn. Springer, New York
[31] Seber GAF, Wild CJ (2003) Nonlinear regression. Wiley series in probability and statistics. Wiley-Interscience, New York · Zbl 0349.62062
[32] Smith, M, Modeling and short-term forecasting of new south wales electricity system load, J Bus Econ Stat, 18, 465-478, (2000)
[33] Soares, L; Medeiros, M, Modeling and forecasting short-term electricity load: a comparison o methods with an application to Brazilian data, Int J Forecast, 24, 630-644, (2008)
[34] Taylor, JW, Short-term electricity demand forecasting using double seasonal exponential smoothing, J Oper Res Soc, 54, 799-805, (2003) · Zbl 1097.91541
[35] Taylor, JW; Buizza, R, Using weather ensemble predictions in electricity demand forecasting, Int J Forecast, 19, 57-70, (2003)
[36] Yang R, Berger J (1998) A catalog of noninformative priors. Institute of Statistics and Decision Sciences, Duke University, Tech. rep.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.