×

The two-stage machine learning ensemble models for stock price prediction by combining mode decomposition, extreme learning machine and improved harmony search algorithm. (English) Zbl 07462479

Summary: As stock data is characterized by highly noisy and non-stationary, stock price prediction is regarded as a knotty problem. In this paper, we propose new two-stage ensemble models by combining empirical mode decomposition (EMD) (or variational mode decomposition (VMD)), extreme learning machine (ELM) and improved harmony search (IHS) algorithm for stock price prediction, which are respectively named EMD-ELM-IHS and VMD-ELM-IHS. Furthermore, to demonstrate the efficiency and performance of the proposed models, the results were compared with those obtained by other methods, including EMD based ELM (EMD-ELM), VMD based ELM (VMD-ELM), autoregressive integrated moving average (ARIMA), ELM, multi-layer perception (MLP), support vector regression (SVR), and long short-term memory (LSTM) models. The results show that the proposed models have superior performance in terms of its accuracy and stability as compared to the other models. Also, we find that the sizes of sliding window and training set have a significant impact on the predictive performance.

MSC:

91G15 Financial markets
68T05 Learning and adaptive systems in artificial intelligence
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Abu Doush, I.; Al-Betar, MA; Awadallah, MA; Santos, E.; Hammouri, AI; Mafarjeh, M.; AlMeraj, Z., Flow shop scheduling with blocking using modified harmony search algorithm with neighboring heuristics methods, Applied Soft Computing, 85, 105861 (2019)
[2] Alatas, B., Chaotic harmony search algorithms, Applied Mathematics & Computation, 216, 9, 2687-2699 (2010) · Zbl 1193.65094
[3] Alia, OM; Mandava, R., The variants of the harmony search algorithm: An overview, Artificial Intelligence Review, 36, 49-68 (2011)
[4] Ané, T.; Ureche-Rangau, L., Stock market dynamics in a regime-switching asymmetric power GARCH model, International Review of Financial Analysis, 15, 2, 109-129 (2006)
[5] Asl, AA; Manaman, NS, Locating magnetic sources by empirical mode decomposition, Journal of Applied Geophysics, 159, 329-340 (2018)
[6] Assad, A.; Deep, K., A hybrid harmony search and simulated annealing algorithm for continuous optimization, Information Sciences, 450, 246-266 (2018)
[7] Bagheri, A.; Ozbulut, OE; Harris, DK, Structural system identification based on variational mode decomposition, Journal of Sound and Vibration, 417, 182-197 (2018)
[8] Baldini, G.; Steri, G.; Giuliani, R.; Dimc, F., Radiometric identification using variational mode decomposition, Computers & Electrical Engineering, 76, 364-378 (2019)
[9] Bisoi, R.; Dash, P.; Parida, A., Hybrid Variational Mode Decomposition and evolutionary robust kernel extreme learning machine for stock price and movement prediction on daily basis, Applied Soft Computing, 74, 652-678 (2019)
[10] Boryczka, U.; Szwarc, K., The harmony search algorithm with additional improvement of harmony memory for asymmetric traveling salesman problem, Expert Systems with Applications, 122, 43-53 (2019)
[11] Burlando, P.; Rosso, R.; Cadavid, LG; Salas, JD, Forecasting of short-term rainfall using ARMA models, Journal of Hydrology, 144, 1, 193-211 (1993)
[12] Cao, J.; Zhao, Y.; Lai, X.; Ong, MEH; Yin, C.; Koh, ZX; Liu, N., Landmark recognition with sparse representation classification and extreme learning machine, Journal of the Franklin Institute, 352, 10, 4528-4545 (2015) · Zbl 1395.68245
[13] Chen, Z.; Chen, W.; Shi, Y., Ensemble learning with label proportions for bankruptcy prediction, Expert Systems with Applications, 146, 113155 (2020)
[14] Contreras, J.; Espinola, R.; Nogales, FJ; Conejo, AJ, ARIMA models to predict next-day electricity prices, IEEE Transactions on Power Systems, 18, 3, 1014-1020 (2003)
[15] Dash, R.; Dash, P.; Bisoi, R., A self adaptive differential harmony search based optimized extreme learning machine for financial time series prediction, Swarm and Evolutionary Computation, 19, 25-42 (2014)
[16] Dragomiretskiy, K.; Zosso, D., Variational mode decomposition, IEEE Transactions on Signal Processing, 62, 3, 531-544 (2014) · Zbl 1394.94163
[17] Efendi, R.; Arbaiy, N.; Deris, MM, A new procedure in stock market forecasting based on fuzzy random auto-regression time series model, Information Sciences, 441, 113-132 (2018) · Zbl 1448.91281
[18] El-Abd, M., An improved global-best harmony search algorithm, Applied Mathematics and Computation, 222, 94-106 (2013) · Zbl 1329.90174
[19] Fischer, T.; Krauss, C., Deep learning with long short-term memory networks for financial market predictions, European Journal of Operational Research, 270, 2, 654-669 (2018) · Zbl 1403.91387
[20] Geem, Z. W. (2000). Optimal design of water distribution networks using harmony search. Ph.D. thesis, Korea University.
[21] Girish, G., Spot electricity price forecasting in Indian electricity market using autoregressive-GARCH models, Energy Strategy Reviews, 11-12, 52-57 (2016)
[22] Hosni, M., Idri, A., Nassif, A., & Abran, A. (2016). Heterogeneous ensembles for software development effort estimation. In 2016 3rd international conference on soft computing & machine intelligence (ISCMI) (pp. 174-178). doi:10.1109/ISCMI.2016.15.
[23] Huang, G.; Zhu, Q.; Siew, C., Extreme learning machine: Theory and applications designs, Neurocomputing, 70, 1, 489-501 (2006)
[24] Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2004). Extreme learning machine: A new learning scheme of feedforward neural networks. In 2004 IEEE international joint conference on neural networks (IEEE Cat. No.04CH37541) (Vol. 2, pp. 985-990).
[25] Huang, G.; Huang, GB; Song, S.; You, K., Trends in extreme learning machines: A review, Neural Networks, 61, 32-48 (2015) · Zbl 1325.68190
[26] Huang, NE; Shen, Z.; Long, SR; Wu, MC; Shih, HH; Zheng, Q.; Yen, NC; Tung, CC; Liu, HH, The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis, Proceedings: Mathematical, Physical and Engineering Sciences, 454, 1971, 903-995 (1998) · Zbl 0945.62093
[27] Jawadi, F.; Chlibi, S.; Cheffou, AI, Computing stock price comovements with a three-regime panel smooth transition error correction model, Annals of Operations Research, 274, 331-345 (2019) · Zbl 1409.91214
[28] Jianwei, E.; Bao, Y.; Ye, J., Crude oil price analysis and forecasting based on variational mode decomposition and independent component analysis, Physica A: Statistical Mechanics and its Applications, 484, 412-427 (2017)
[29] Keshtegar, B.; Ozbakkaloglu, T.; Gholampour, A., Modeling the behavior of FRP-confined concrete using dynamic harmony search algorithm, Engineering with Computers, 33, 3, 415-430 (2017)
[30] Kim, M.; Chun, H.; Kim, J.; Kim, K.; Yu, J.; Kim, T.; Han, S., Data-efficient parameter identification of electrochemical lithium-ion battery model using deep Bayesian harmony search, Applied Energy, 254, 113644 (2019)
[31] Krawczyk, B.; Cano, A., Online ensemble learning with abstaining classifiers for drifting and noisy data streams, Applied Soft Computing, 68, 677-692 (2018)
[32] Laboissiere, LA; Fernandes, RA; Lage, GG, Maximum and minimum stock price forecasting of Brazilian power distribution companies based on artificial neural networks, Applied Soft Computing, 35, 66-74 (2015)
[33] Lahmiri, S., Intraday stock price forecasting based on variational mode decomposition, Journal of Computational Science, 12, 23-27 (2016)
[34] Lee, J.; Wang, W.; Harrou, F.; Sun, Y., Reliable solar irradiance prediction using ensemble learning-based models: A comparative study, Energy Conversion and Management, 208, 112582 (2020)
[35] Lei, L., Wavelet neural network prediction method of stock price trend based on rough set attribute reduction, Applied Soft Computing, 62, 923-932 (2018)
[36] Li, J.; Zhu, S.; Wu, Q., Monthly crude oil spot price forecasting using variational mode decomposition, Energy Economics, 83, 240-253 (2019)
[37] Li, X.; Wei, Y., The dependence and risk spillover between crude oil market and China stock market: New evidence from a variational mode decomposition-based copula method, Energy Economics, 74, 565-581 (2018)
[38] Liu, CF; Yeh, CY; Lee, SJ, Application of type-2 neuro-fuzzy modeling in stock price prediction, Applied Soft Computing, 12, 4, 1348-1358 (2012)
[39] Liu, H.; Xu, Y.; Chen, C., Improved pollution forecasting hybrid algorithms based on the ensemble method, Applied Mathematical Modelling, 73, 473-486 (2019) · Zbl 1481.86026
[40] Manjarres, D.; Landa-Torres, I.; Gil-Lopez, S.; Ser, JD; Bilbao, M.; Salcedo-Sanz, S.; Geem, Z., A survey on applications of the harmony search algorithm, Engineering Applications of Artificial Intelligence, 26, 8, 1818-1831 (2013)
[41] Mohammed, A.; Minhas, R.; Wu, QJ; Sid-Ahmed, M., Human face recognition based on multidimensional PCA and extreme learning machine, Pattern Recognition, 44, 10, 2588-2597 (2011) · Zbl 1218.68149
[42] Ouyang, HB; Gao, LQ; Li, S.; Kong, XY; Wang, Q.; Zou, DX, Improved harmony search algorithm: LHS, Applied Soft Computing, 53, 133-167 (2017)
[43] Poole, DJ; Allen, CB, Constrained niching using differential evolution, Swarm and Evolutionary Computation, 44, 74-100 (2019)
[44] Rahmati, SHA; Ahmadi, A.; Govindan, K., A novel integrated condition-based maintenance and stochastic flexible job shop scheduling problem: Simulation-based optimization approach, Annals of Operations Research, 269, 583-621 (2018) · Zbl 1434.90068
[45] Razzaghi, T.; Safro, I.; Ewing, J.; Sadrfaridpour, E.; Scott, JD, Predictive models for bariatric surgery risks with imbalanced medical datasets, Annals of Operations Research, 280, 1-2, 1-18 (2019) · Zbl 1494.62026
[46] Rilling, G.; Flandrin, P., One or two frequencies? The empirical mode decomposition answers, IEEE Transactions on Signal Processing, 56, 1, 85-95 (2008) · Zbl 1390.94382
[47] Sarantis, N., Nonlinearities, cyclical behaviour and predictability in stock markets: International evidence, International Journal of Forecasting, 17, 3, 459-482 (2001)
[48] Sezer, OB; Ozbayoglu, AM, Algorithmic financial trading with deep convolutional neural networks: Time series to image conversion approach, Applied Soft Computing, 70, 525-538 (2018)
[49] Shen, S.; Sadoughi, M.; Li, M.; Wang, Z.; Hu, C., Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries, Applied Energy, 260, 114296 (2020)
[50] Tang, L.; Wang, S.; He, K.; Wang, S., A novel mode-characteristic-based decomposition ensemble model for nuclear energy consumption forecasting, Annals of Operations Research, 234, 111-132 (2015) · Zbl 1406.91303
[51] Ticknor, JL, A Bayesian regularized artificial neural network for stock market forecasting, Expert Systems with Applications, 40, 14, 5501-5506 (2013)
[52] Wang, G.; Jia, R.; Liu, J.; Zhang, H., A hybrid wind power forecasting approach based on Bayesian model averaging and ensemble learning, Renewable Energy, 145, 2426-2434 (2020)
[53] Wang, Z.; Wang, Y.; Srinivasan, RS, A novel ensemble learning approach to support building energy use prediction, Energy and Buildings, 159, 109-122 (2018)
[54] Wei Liu, YC; Cao, Siyuan, Applications of variational mode decomposition in seismic time-frequency analysis, Geophysics, 81, 5, 365-378 (2016)
[55] Weng, B.; Lu, L.; Wang, X.; Megahed, FM; Martinez, W., Predicting short-term stock prices using ensemble methods and online data sources, Expert Systems with Applications, 112, 258-273 (2018)
[56] Xiao, W.; Zhang, J.; Li, Y.; Zhang, S.; Yang, W., Class-specific cost regulation extreme learning machine for imbalanced classification, Neurocomputing, 261, 70-82 (2017)
[57] Yang, L.; Zhao, L.; Wang, C., Portfolio optimization based on empirical mode decomposition, Physica A: Statistical Mechanics and its Applications, 531, 121813 (2019)
[58] Yeh, CY; Huang, CW; Lee, SJ, A multiple-kernel support vector regression approach for stock market price forecasting, Expert Systems with Applications, 38, 3, 2177-2186 (2011)
[59] Yu, Z.; Wang, D.; You, J.; Wong, HS; Wu, S.; Zhang, J.; Han, G., Progressive subspace ensemble learning, Pattern Recognition, 60, 692-705 (2016)
[60] Zhang, J.; Teng, YF; Chen, W., Support vector regression with modified firefly algorithm for stock price forecasting, Applied Intelligence, 49, 5, 1658-1674 (2019)
[61] Zhang, T.; Geem, ZW, Review of harmony search with respect to algorithm structure, Swarm and Evolutionary Computation, 48, 31-43 (2019)
[62] Zhou, F.; min, Zhou H.; Yang, Z.; Yang, L., EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction, Expert Systems with Applications, 115, 136-151 (2019)
[63] Zhou, Y.; Wang, P., An ensemble learning approach for XSS attack detection with domain knowledge and threat intelligence, Computers & Security, 82, 261-269 (2019)
[64] Zhu, B.; Ye, S.; He, K.; Chevallier, J.; Xie, R., Measuring the risk of European carbon market: An empirical mode decomposition-based value at risk approach, Annals of Operations Research, 281, 373-395 (2019) · Zbl 1434.62242
[65] Zhu, J.; Wu, P.; Chen, H.; Liu, J.; Zhou, L., Carbon price forecasting with variational mode decomposition and optimal combined model, Physica A: Statistical Mechanics and Its Applications, 519, 140-158 (2019) · Zbl 1514.62334
[66] Zhu, Q.; Tang, X.; Li, Y.; Yeboah, MO, An improved differential-based harmony search algorithm with linear dynamic domain, Knowledge-Based Systems, 187, 104809 (2020)
[67] Zhukov, A.; Tomin, N.; Kurbatsky, V.; Sidorov, D.; Panasetsky, D.; Foley, A., Ensemble methods of classification for power systems security assessment, Applied Computing and Informatics, 15, 1, 45-53 (2019)
[68] Zou, D.; Gao, L.; Wu, J.; Li, S.; Li, Y., A novel global harmony search algorithm for reliability problems, Computers & Industrial Engineering, 58, 2, 307-316 (2010)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.