Online EM algorithm for mixture with application to Internet traffic modeling. (English) Zbl 1431.62338

Summary: Since histograms of many real network traces show strong evidence of mixture, this paper uses mixture distributions to model Internet traffic and applies the EM algorithm to fit the models. Making use of the fact that at each iteration of the EM algorithm the parameter increment has a positive projection on the gradient of the likelihood function, this paper proposes an online EM algorithm to fit the models and the Bayesian Information Criterion is applied to select the best model. Experimental results on real traces are provided to illustrate the efficiency of the proposed algorithm.


62L20 Stochastic approximation
62F10 Point estimation
62-08 Computational methods for problems pertaining to statistics
Full Text: DOI


[1] Anderson, A.T.; Nielsen, B.F., A Markovian approach for modeling packet traffic with heavy-range dependence, IEEE J. selected areas comm., 16, 5, 719-732, (1998)
[2] Chen, H.F., Stochastic approximation with state-dependent noise, Sci. China ser. E, 43, 5, 531-541, (2000), (available at http://www.scienceinchina.com/yk/ye/0005/ye0531.stm) · Zbl 1232.90313
[3] Chen, H.F., Stochastic approximation and its application, (2002), Kluwer Dordrecht
[4] Chen, H.F.; Guo, L.; Gao, A.J., Convergence and robustness of the robbins – monro algorithm truncated at randomly varying bounds, Stochastic processes appl., 27, 217-231, (1988) · Zbl 0632.62082
[5] Fort, J.; Pages, G., Convergence of stochastic algorithmsfrom the kushner – clark theorem to the Lyapounov functional method, Adv. appl. probab., 28, 1072-1094, (1996) · Zbl 0881.62085
[6] Ma, D.J.; Makowski, A.M., Stochastic approximations for finite-state Markov chains, Stochastic processes appl., 35, 27-45, (1990) · Zbl 0718.60074
[7] McLachlan, G.J.; Krishnan, T., The EM algorithm and extensions, (1997), Wiley New York · Zbl 0882.62012
[8] Park, K.; Willinger, W., Self-similar network traffic and performance evaluation, (2001), Wiley New York
[9] Robert, S.; LeBoudec, J., New models for self-similar traffic, Performance evaluation, 30, 1, 57-68, (1997)
[10] Schwarz, G., Estimating the dimension of a model, Ann. statist., 6, 461-464, (1978) · Zbl 0379.62005
[11] Xu, L.; Jordan, M.I., On convergence properties of the EM algorithm for Gaussian mixtures, Neural comput., 8, 1, 129-151, (1996)
[12] Yakowitz, S.J.; Spragins, J.D., On the identifiability of finite mixture, Ann. math. statist., 39, 209-214, (1968) · Zbl 0155.25703
[13] Yoshihara, T.; Kasahara, S.; Takahashi, Y., Practical time-scale Fitting of self-similar traffic with Markov-modulated Poisson process, Telecommunication systems, 17, 185-211, (2001) · Zbl 1030.68906
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.