Stacked heterogeneous neural networks for time series forecasting. (English) Zbl 1189.62154

Summary: A hybrid model for time series forecasting is proposed. It is a stacked neural network, containing one normal multilayer perceptron with bipolar sigmoid activation functions, and the other with an exponential activation function in the output layer. As shown by the case studies, the proposed stacked hybrid neural model performs well on a variety of benchmark time series. The combination of weights of the two stack components that leads to optimal performance is also studied.


62M20 Inference from stochastic processes and prediction
62M45 Neural nets and related approaches to inference from stochastic processes
62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)
Full Text: DOI EuDML


[1] H. Tong, Threshold Models in Nonlinear Time Series Analysis, vol. 21 of Lecture Notes in Statistics, Springer, New York, NY, USA, 1983. · Zbl 0559.10027
[2] D. Pfeffermann and J. Allon, “Multivariate exponential smoothing: method and practice,” International Journal of Forecasting, vol. 5, no. 1, pp. 83-98, 1989.
[3] J. L. Harvill and B. K. Ray, “A note on multi-step forecasting with functional coefficient autoregressive models,” International Journal of Forecasting, vol. 21, no. 4, pp. 717-727, 2005.
[4] M. Ghiassi and S. Nangoy, “A dynamic artificial neural network model for forecasting nonlinear processes,” Computers and Industrial Engineering, vol. 57, no. 1, pp. 287-297, 2009.
[5] P. J. Brockwell and R. A. Davis, Time Series: Theory and Methods, Springer Series in Statistics, Springer, New York, NY, USA, 2nd edition, 1991. · Zbl 0709.62080
[6] N. Ravishanker and B. K. Ray, “Bayesian prediction for vector ARFIMA processes,” International Journal of Forecasting, vol. 18, no. 2, pp. 207-214, 2002.
[7] F. M. Tseng, H. C. Yu, and G. H. Tzeng, “Combining neural network model with seasonal time series ARIMA model,” Technological Forecasting and Social Change, vol. 69, no. 1, pp. 71-87, 2002.
[8] M. V. D. Voort, M. Dougherty, and S. Watson, “Combining Kohonen maps with ARIMA time series models to forecast traffic flow,” Transportation Research Part C, vol. 4, no. 5, pp. 307-318, 1996.
[9] D. K. Wedding II and K. J. Cios, “Time series forecasting by combining RBF networks, certainty factors, and the Box-Jenkins model,” Neurocomputing, vol. 10, no. 2, pp. 149-168, 1996. · Zbl 0850.68058
[10] C.-M. Lee and C.-N. Ko, “Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm,” Neurocomputing, vol. 73, no. 1-3, pp. 449-460, 2009. · Zbl 05721236
[11] G. Toma, “Specific differential equations for generating pulse sequences,” Mathematical Problems in Engineering, vol. 2010, Article ID 324818, 11 pages, 2010. · Zbl 1191.37052
[12] E. G. Bakhoum and C. Toma, “Mathematical transform of traveling-wave equations and phase aspects of quantum interaction,” Mathematical Problems in Engineering, vol. 2010, Article ID 695208, 15 pages, 2010. · Zbl 1191.35220
[13] M. Khasei and M. Bijari, “An artificial neural network (p,d,q) model for timeseries forecasting,” Expert Systems with Applications, vol. 37, no. 1, pp. 479-489, 2010. · Zbl 05884049
[14] K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, no. 5, pp. 359-366, 1989. · Zbl 1383.92015
[15] A. E. Bryson and Y. C. Ho, Applied Optimal Control, Blaisdell, New York, NY, USA, 1969.
[16] D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClelland, Eds., vol. 1, pp. 318-362, MIT Press, Cambridge, Mass, USA, 1986.
[17] F. M. Silva and L. B. Almeida, “Acceleration techniques for the backpropagation algorithm,” in Neural Networks, L. B. Almeida and C. J. Wellekens, Eds., pp. 110-119, Springer, Berlin, Germany, 1990.
[18] M. Ghiassi and H. Saidane, “A dynamic architecture for artificial neural networks,” Neurocomputing, vol. 63, pp. 397-413, 2005. · Zbl 02223932
[19] L. Stone and D. He, “Chaotic oscillations and cycles in multi-trophic ecological systems,” Journal of Theoretical Biology, vol. 248, no. 2, pp. 382-390, 2007.
[20] G. Janacek, Practical Time Series, Oxford University Press, Oxford, UK, 2001. · Zbl 0956.62072
[21] SAS Institute, “SAS (Statistical Analysis System),” http://www.sas.com/.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.