A tutorial on nonlinear time-series data mining in engineering asset health and reliability prediction: concepts, models, and algorithms. (English) Zbl 1189.90047

Summary: The primary objective of engineering asset management is to optimize assets service delivery potential and to minimize the related risks and costs over their entire life through the development and application of asset health and usage management in which the health and reliability prediction plays an important role. In real-life situations where an engineering asset operates under dynamic operational and environmental conditions, the lifetime of an engineering asset is generally described as monitored nonlinear time-series data and subject to high levels of uncertainty and unpredictability. It has been proved that application of data mining techniques is very useful for extracting relevant features which can be used as parameters for assets diagnosis and prognosis. In this paper, a tutorial on nonlinear time-series data mining in engineering asset health and reliability prediction is given. Besides that an overview on health and reliability prediction techniques for engineering assets is covered, this tutorial will focus on concepts, models, algorithms, and applications of hidden Markov models (HMMs) and hidden semi-Markov models (HSMMs) in engineering asset health prognosis, which are representatives of recent engineering asset health prediction techniques.


90B25 Reliability, availability, maintenance, inspection in operations research
62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)
62N05 Reliability and life testing
62P30 Applications of statistics in engineering and industry; control charts


Full Text: DOI EuDML


[1] B. V. Kini and C. C. Sekhar, “Multi-scale kernel latent variable models for nonlinear time series pattern matching,” in Proceedings of the 14th International Conference on Neural Information Processing (ICONIP ’08), vol. 4985 of Lecture Notes in Computer Science, pp. 11-20, 2008. · Zbl 05297972
[2] W.-K. Ching and M. K. Ng, Markov Chains: Models, Algorithms and Applications, International Series in Operations Research & Management Science, 83, Springer, New York, NY, USA, 2006. · Zbl 1181.92034
[3] J. Fan and Q. Yao, Nonlinear Time Series: Nonparametric and Parametric Method, Springer, New York, NY, USA, 2005.
[4] A. K. S. Jardine, D. Lin, and D. Banjevic, “A review on machinery diagnostics and prognostics implementing condition-based maintenance,” Mechanical Systems and Signal Processing, vol. 20, no. 7, pp. 1483-1510, 2006.
[5] G. Van Dijck, Information theoretic approach to feature selection and redundancy assessment, Ph.D. dissertation, Katholieke Universiteit Leuven, 2008.
[6] P. Baruah and R. B. Chinnam, “HMMs for diagnostics and prognostics in machining processes,” in Proceedings of the 57th Society for Machine Failure Prevention Technology Conference, Virginia Beach, Va, USA, April 2003. · Zbl 1068.90554
[7] R. J. Povinelli, Time series data mining: identifying temporal patterns for characterization and prediction of time series events, Ph.D. dissertation, Marquette University, Milwaukee, Wis, USA, 1999.
[8] F. Laio, A. Porporato, R. Revelli, and L. Ridolfi, “A comparison of nonlinear forecasting methods,” Water Resources Research, vol. 39, no. 5, pp. TNN21-TNN24, 2003.
[9] A. Mathur, “Data mining of aviation data for advancing health management,” in Component and Systems Diagnostics, Prognostics, and Health Management II, vol. 4733 of Proceedings of SPIE, pp. 61-71, 2002.
[10] G. Das, K. P. Lin, H. Mannila, G. Renganathan, and P. Smyth, “Rule discovery from time series,” in Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining (KDD ’98), pp. 16-22, AAAI Press, 1998.
[11] R. Agrawal and R. Srikant, “Mining sequential patterns,” in Proceedings of the International Conference on Data Engineering (ICDE ’95), pp. 3-14, Taipei, Taiwan, 1995.
[12] T. L. Lai and S. P.-S. Wong, “Stochastic neural networks with applications to nonlinear time series,” Journal of the American Statistical Association, vol. 96, no. 455, pp. 968-981, 2001. · Zbl 1051.62096
[13] K. Parasuraman and A. Elshorbagy, “Wavelet networks: an alternative to classical neural networks,” in Proceedings of the International Joint Conference on Neural Networks, vol. 5, pp. 2674-2679, Montreal, Canada, 2005.
[14] M. Li, “Fractal time series-a tutorial review,” Mathematical Problems in Engineering, vol. 2010, Article ID 157264, 26 pages, 2010. · Zbl 1191.37002
[15] M. Li and J. Li, “On the predictability of long-range dependent series,” Mathematical Problems in Engineering, vol. 2010, Article ID 397454, 9 pages, 2010. · Zbl 1191.62160
[16] G. Vachtsevanos and P. Wang, “Fault prognosis using dynamic wavelet neural networks,” in Proceedings of IEEE Systems Readiness Technology Conference (AUTOTESTCON ’01), pp. 857-870, 2001. · Zbl 0981.68510
[17] T. Brotherton, G. Jahns, J. Jacobs, and D. Wroblewski, “Prognosis of faults in gas turbine engines,” in Proceedings of the IEEE Aerospace Conference, vol. 6, pp. 163-172, 2000.
[18] M. Orchard, B. Wu, and G. Vachtsevanos, “A particle filter framework for failure prognosis,” in Proceedings of the World Tribology Congress, Washington, DC, USA, 2005.
[19] S. Zhang, L. Ma, Y. Sun, and J. Mathew, “Asset health reliability estimation based on condition data,” in Proceedings of the 2nd World Congress on Engineering Asset Management and the 4th International Congress of Chinese Mathematicians (ICCM ’07), pp. 2195-2204, Harrogate, UK, 2007.
[20] V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995. · Zbl 0833.62008
[21] D. B. Percival and A. T. Walden, Wavelet Methods for Time Series Analysis, vol. 4 of Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge University Press, Cambridge, UK, 2000. · Zbl 0963.62079
[22] M. J. Roemer, E. O. Nwadiogbu, and G. Bloor, “Development of diagnostic and prognostic technologies for aerospace health management applications,” in Proceedings of the IEEE Aerospace Conference, vol. 6, pp. 63139-63147, Big Sky, Mont, USA, March 2001.
[23] C. Damle and A. Yalcin, “Flood prediction using time series data mining,” Journal of Hydrology, vol. 333, no. 2-4, pp. 305-316, 2007.
[24] C. Bunks, D. McCarthy, and T. Al-Ani, “Condition-based maintenance of machines using hidden Markov models,” Mechanical Systems and Signal Processing, vol. 14, no. 4, pp. 597-612, 2000.
[25] A. Ljolje and S. E. Levinson, “Development of an acoustic-phonetic hidden Markov model for continuous speech recognition,” IEEE Transactions on Signal Processing, vol. 39, no. 1, pp. 29-39, 1991.
[26] C. Kwan, X. Zhang, R. Xu, and L. Haynes, “A novel approach to fault diagnostics and prognostics,” in Proceedings of the IEEE International Conference on Robotics and Automation, vol. 1, pp. 604-609, Taipei, Taiwan, 2003.
[27] P. D. McFadden and J. D. Smith, “Vibration monitoring of rolling element bearings by the high-frequency resonance technique-a review,” Tribology International, vol. 17, no. 1, pp. 3-10, 1984.
[28] L. R. Rabiner, “Tutorial on hidden Markov models and selected applications in speech recognition,” Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.
[29] M. J. Russell and R. K. Moore, “Explicit modeling of state occupancy in hidden Markov models for automatic speech recognition,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP ’85), pp. 5-8, Tampa, Fla, USA, 1985.
[30] L. E. Baum and J. A. Eagon, “An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecology,” Bulletin of the American Mathematical Society, vol. 73, pp. 360-363, 1967. · Zbl 0157.11101
[31] A. J. Viterbi, “Error bounds for convolutional codes and an asymptotically optimal decoding algorithm,” IEEE Transaction on Information Theory, vol. 13, pp. 260-269, 1967. · Zbl 0148.40501
[32] A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” Journal of the Royal Statistical Society, vol. 39, no. 1, pp. 1-38, 1977. · Zbl 0364.62022
[33] M. Dong and D. He, “Hidden semi-Markov model-based methodology for multi-sensor equipment health diagnosis and prognosis,” European Journal of Operational Research, vol. 178, no. 3, pp. 858-878, 2007. · Zbl 1163.90784
[34] M. Dong, D. He, P. Banerjee, and J. Keller, “Equipment health diagnosis and prognosis using hidden semi-Markov models,” International Journal of Advanced Manufacturing Technology, vol. 30, no. 7-8, pp. 738-749, 2006.
[35] D. He, D. Wang, A. Babayan, and Q. Zhang, “Intelligent equipment health diagnosis and prognosis using wavelet,” in Proceedings of the Conference on Automation Technology for Off-Road Equipment, pp. 77-88, Chicago, Ill, USA, 2002.
[36] P. Pawelski and D. He, “Vibration based pump health monitoring,” Journal of Commercial Vehicles, vol. 2, pp. 636-639, 2005.
[37] M. Dong and D. He, “A segmental hidden semi-Markov model (HSMM)-based diagnostics and prognostics framework and methodology,” Mechanical Systems and Signal Processing, vol. 21, no. 5, pp. 2248-2266, 2007.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.