Performance analysis of multi-innovation gradient type identification methods. (English) Zbl 1140.93488

Summary: It is well-known that the stochastic gradient (SG) identification algorithm has poor convergence rate. In order to improve the convergence rate, we extend the SG algorithm from the viewpoint of innovation modification and present multi-innovation gradient type identification algorithms, including a multi-innovation stochastic gradient (MISG) algorithm and a multi-innovation forgetting gradient (MIFG) algorithm. Because the multi-innovation gradient type algorithms use not only the current data but also the past data at each iteration, parameter estimation accuracy can be improved. Finally, the performance analysis and simulation results show that the proposed MISG and MIFG algorithms have faster convergence rates and better tracking performance than their corresponding SG algorithms.


93E12 Identification in stochastic control theory
93E03 Stochastic systems in control theory (general)
Full Text: DOI


[1] Chen, H.F.; Guo, L., Adaptive control via consistent estimation for deterministic systems, International journal of control, 45, 6, 2183-2202, (1987) · Zbl 0624.93036
[2] Ding, F.; Chen, T., Combined parameter and output estimation of dual-rate systems using an auxiliary model, Automatica, 40, 10, 1739-1748, (2004) · Zbl 1162.93376
[3] Ding, F.; Chen, T., Performance bounds of forgetting factor least squares algorithm for time-varying systems with finite measurement data, IEEE transactions on circuits and systems—I: regular papers, 52, 3, 555-566, (2005) · Zbl 1374.93390
[4] Ding, F.; Chen, T., Parameter estimation of dual-rate stochastic systems by using an output error method, IEEE transactions on automatic control, 50, 9, 1436-1441, (2005) · Zbl 1365.93480
[5] Ding, F.; Chen, T., Identification of Hammerstein nonlinear ARMAX systems, Automatica, 41, 9, 1479-1489, (2005) · Zbl 1086.93063
[6] Ding, F.; Chen, T., Hierarchical gradient-based identification of multivariable discrete-time systems, Automatica, 41, 2, 315-325, (2005) · Zbl 1073.93012
[7] Ding, F.; Chen, T., Hierarchical least squares identification methods for multivariable systems, IEEE transactions on automatic control, 50, 3, 397-402, (2005) · Zbl 1365.93551
[8] Ding, F., & Chen, T., (2006). Multi-innovation stochastic gradient identification methods. Proceedings of the sixth world congress on intelligent control and automation (WCICA2006), June 21-23, 2006, Dalian, China (pp. 1501-1505).
[9] Ding, F.; Shi, Y.; Chen, T., Performance analysis of estimation algorithms of non-stationary ARMA processes, IEEE transactions on signal processing, 54, 3, 1041-1053, (2006) · Zbl 1373.94569
[10] Ding, F.; Xiao, D.Y.; Ding, T., Multi-innovation stochastic gradient identification methods, Control theory and applications, 20, 6, 870-874, (2003)
[11] Ding, F.; Xie, X.M.; Fang, C.Z., Multi-innovation identification methods for time-varying systems, Acta automatica sinica, 22, 1, 85-91, (1996) · Zbl 0852.93020
[12] Goodwin, G.C.; Sin, K.S., Adaptive filtering, prediction and control, (1984), Prentice-Hall Englewood Cliffs, NJ · Zbl 0653.93001
[13] Guo, L., Convergence and logarithm laws of self-tuning regulators, Automatica, 31, 3, 435-450, (1995) · Zbl 0825.93337
[14] Guo, L.; Ljung, L., Exponential stability of general tracking algorithms, IEEE transactions on automatic control, 40, 8, 1376-1387, (1995) · Zbl 0834.93059
[15] Guo, L.; Ljung, L., Performance analysis of general tracking algorithms, IEEE transactions on automatic control, 40, 8, 1388-1402, (1995) · Zbl 0834.93050
[16] Kumar, K., On the identification of autoregressive moving average models, Control and intelligent systems, 28, 2, 41-46, (2000)
[17] Lai, T.L.; Wei, C.Z., Least squares estimates in stochastic regression models with applications to identification and control of dynamic systems, Annals of statistics, 10, 1, 154-166, (1982) · Zbl 0488.62071
[18] Lai, T. L., & Wei, C. Z. (1986). Extended least squares and their applications to adaptive control and prediction in linear systems IEEE Transactions on Automatic Control, 31(10), 898-906. · Zbl 0603.93060
[19] Ljung, L., Consistency of the least-squares identification method, IEEE transactions on automatic control, 21, 5, 779-781, (1976) · Zbl 0334.93048
[20] Ljung, L., System identification: theory for the user, (1999), Prentice-Hall Englewood Cliffs, NJ
[21] Ren, W.; Kumar, P.K., Stochastic adaptive prediction and model reference control, IEEE transactions on automatic control, 39, 10, 2047-2060, (1994) · Zbl 0827.93071
[22] Wei, C.Z., Adaptive prediction by least squares prediction in stochastic regression models, Annals of statistics, 15, 4, 1667-1682, (1987) · Zbl 0643.62058
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.