Association rule mining through adaptive parameter control in particle swarm optimization. (English) Zbl 1342.65036

Summary: Association rule mining is a data mining task on a great deal of academic research has been done and many algorithms are proposed. Association rule mining is treated as a twofold process by most of the methods. It increases the complexity of the system and takes up more time and space. Evolutionary Computation (EC) are fast growing search based optimization method for association rule mining. Among ECs particle swarm optimization (PSO) is more suited for mining association rules. The bottleneck of PSO is setting the precise values for their control parameters. Setting values to the control parameter is done either through parameter tuning or parameter control. This paper proposes an adaptive methodology for the control parameters in PSO namely, acceleration coefficients and inertia weight based on estimation of evolution state and fitness value respectively. Both of the proposed adaptive methods when tested on five datasets from University of California Irvine (UCI) repository proved to generate association rules with better accuracy and rule measures compared to simple PSO.


65C60 Computational problems in statistics (MSC2010)
90C59 Approximation methods and heuristics in mathematical programming


Full Text: DOI


[1] Agrawal, R; Imielinski, T; Swami, A; Buneman, P (ed.); Jajodia, S (ed.), Mining association rules between sets of items in large databases, 207-216, (1993), New York
[2] Agrawal R, Srikant R (1994) Fast algorithms for mining association rules in large databases. In: Bocca JB, Jarke M, Zaniolo C (eds) Proceedings of the 20th international conference on very large data bases, Morgan Kaufmann, Burlington, pp 478-499
[3] Back T (1992) Self-adaptation in genetic algorithms. In: Proceedings of the 1st European conference on artificial life, pp 263-271
[4] Brin S, Motwani R, Ullman JD, Tsur S (1997) Dynamic itemset counting and implication rules for market basket data. In: Peckham J (eds) Proceedings of the 1997 ACM SIGMOD international conference on management of data, pp 255-264
[5] Burke EK, Hyde M, Kendall G et al (2009) A survey of hyper-heuristics. In: Technical report NOTTCS-TR-SUB-0906241418-2747, School of computer science and information technology, University of Nottingham
[6] Carlisle DG (2001) An off-the-shelf PSO. In: Proceeding on particle swarm optimization. Purdue School of Engineering and Technology, Indianapolis, pp 1-6
[7] Ceglar, A; Roddick, JF, Association mining, ACM Comput Surv, 38, 5, (2006)
[8] Chang CI, Chueh HE, Lin NP (2009) Sequential patterns mining with fuzzy time-intervals. In: Sixth international conference on fuzzy systems and knowledge discovery, pp 165-169
[9] Chatterjee, A; Siarry, P, Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization, Comput Oper Res, 33, 859-871, (2006) · Zbl 1114.90159
[10] Clark P, Boswell R (1991) Rule induction with CN2: Some recent improvements. In: Proceedings of the European working session on learning, pp 151-163
[11] Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science. IEEE Service Center, Piscataway, NJ, pp 39-43 · Zbl 1242.68288
[12] Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, Berlin · Zbl 1028.68022
[13] Eiben, AE; Michalewicz, Z; Schoenauer, M; Smith, JE; Lobo, FG (ed.); Lima, CF (ed.); Michalewicz, Z (ed.), Parameter control in evolutionary algorithms, 19-46, (2007), Berlin
[14] Engelbrecht AP (2006) Fundamentals of computational swarm intelligence. Wiley, New York
[15] Good IJ (1965) The estimation of probabilities: an essay on modern Bayesian methods. MIT Press, Cambridge · Zbl 0168.39603
[16] Han J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann, Burlington · Zbl 1445.68004
[17] Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation, In: Proceeding of SIGMOD’00, Dallas, TX, May 2000, pp 1-12
[18] Indira K, Kanmani S (2012) Association rule mining using self adaptive particle swarm optimization. IJCA Special Issue on Computational Intelligence and Information Security CIIS, pp 27-31
[19] Indira K, Kanmani S et al (2012) Population Based Search Methods in Mining Association Rules. In: Third international conference on advances in communication, network, and computing—CNC 2012, LNCS, pp 255-261
[20] Juang, Y-T; Tung, S-L; Chiu, H-C, Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions, Inf Sci, 181, 4539-4549, (2011) · Zbl 1242.68288
[21] Kennedy J, Eberhart RC (2001) Swarm intelligence. Morgan Kaufman, Burlington
[22] Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceeding of the IEEE international conference on neural networks, pp 1942-1948
[23] Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 congress on evolutionary computation, pp 1671-1676
[24] Kuo, RJ; Chao, CM; Chiu, YT, Application of particle swarm optimization to association rule mining, Appl Soft Comput, 11, 326-336, (2011)
[25] Leung, SW; Yuen, SY; Chow, CK, Parameter control system of evolutionary algorithm that is aided by the entire search history, Appl Soft Comput, 12, 3063-3078, (2012)
[26] Liu B, Abbas HA, McKay B (2003) Classification rule discovery with ant colony optimization. In: IEEE/WIC international conference on intelligent agent technology, 13-17 October, Halifax, Canada, pp 83-88 · Zbl 1149.90432
[27] Liu B, Hsu W, Ma Y (1999) Pruning and summarizing the discovered associations. In: Proceeding of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 125-136
[28] Mahor, A; Rangnekar, S, Short term generation scheduling of cascaded hydro electric system using novel self adaptive inertia weight PSO, Int J Electr Power Energy Syst, 36, 1-9, (2012)
[29] Mendes, R; Kennedy, J; Neves, J, The fully informed particle swarm: simpler, maybe better, IEEE Trans Evol Comput, 8, 204-210, (2004)
[30] Merz CJ, Murphy P (1996) UCI repository of machine learning databases. http://www.cs.uci.edu/mlearn/MLRepository.html
[31] Nannen V, Smit SK, Eiben AE (2008) Costs and benefits of tuning parameters of evolutionary algorithms. In: Proceedings of the 10th international conference on parallel problem solving from nature. PPSN X, Dortmund, Germany, pp 528-538 · Zbl 1242.68288
[32] Özbakır, L; Baykasoglu, A; Kulluk, S; Yapıcı, H, TACO-miner: an ant colony based algorithm for rule extraction from trained neural networks, Expert Syst Appl, 36, 12295-12305, (2010)
[33] Özbakır L, Baykasoglu A, Kulluk S (2008) Rule extraction from neural networks via ant colony algorithm for data mining applications. In: Lecture notes in computer science 5313, pp 177-191 · Zbl 1114.90159
[34] Parpinelli, RS; Lopes, HS; Freitas, AA, Data mining with an ant colony optimization algorithm, IEEE Trans Evol Comput, 6, 321-332, (2002)
[35] Parsopoulos KE, Vrahatis MN (2004) Unified particle swarm optimization scheme. In: Proceeding in lecture series on computational sciences, pp 868-873 · Zbl 1242.68297
[36] Parsopoulos, KE; Vrahatis, MN, Parameter selection and adaptation in unified particle swarm optimization, Math Comput Model, 46, 198-213, (2007) · Zbl 1149.90432
[37] Piatetsky-Shapiro G (1991) Discovery, analysis, and presentation of strong rules. In: Knowledge discovery in databases, AAAI/MIT Press, pp 229-248
[38] Ratnaweera, A; Halgamuge, SK; Watson, HC, Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients, IEEE Trans Evol Comput, 8, 240-255, (2004)
[39] Ratnaweera A, Halgamuge S, Watson H (2003) Particle Swarm Optimization with self-adaptive acceleration coefficients. In: Proceedings of first international conference on fuzzy systems and knowledge discovery, pp 264-268
[40] Senthil Arumugam M, Rao MVC (2008) On the improved performances of the particle swarm optimization algorithms with adaptive parameters, crossover operators and root mean square (RMS) variants for computing optimal control of a class of hybrid systems. Appl Soft Comput 8(1):324-336
[41] Shenoy PD, Srinivasa KG, Venugopal KR, Patnaik LM (2003) Evolutionary approach for mining association rules on dynamic databases. In: Proceeding of Pacific-Asia conference on knowledge discovery and data mining, LNAI, 2637, Springer, Berlin, pp 325-336 · Zbl 1032.68631
[42] Shi, Y; Eberhart, RC, Fuzzy adaptive particle swarm optimization, Proc IEEE Congress Evolut Comput, 1, 101-106, (2001)
[43] Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: Proceeding of the 7th conference on evolutionary programming, New York, pp 591-600
[44] Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 1945-1950
[45] Song MP, Gu GC (2004) Research on particle swarm optimization: A review. In: Proceedings of the IEEE international conference on machine learning and cybernetics, pp 2236-2241
[46] Tripathi PK, Bandyopadhyay KS, Pal SK (2007) Adaptive multi-objective particle swarm optimization agorithm. IN: Proceedings of IEEE congress on evolutionary computation, pp 2281-2288
[47] Vrugt, JA; Robinson, BA; Hyman, JM, Self-adaptive multimethod search for global optimization in real-parameter spaces, IEEE Trans Evol Comput, 13, 243-259, (2009)
[48] Vzquez JM, lvarez Macas JL, Santos JCR (2002) Discovering numeric association rules via evolutionary algorithm. In: Pacific-Asia conference on knowledge discovery and data mining, pp 40-51
[49] Wang, Y; Li, B; Weise, T; Wang, J; Yuan, B; Tian, Q, Self-adaptive learning based particle swarm optimization, Inf Sci, 181, 4515-4538, (2011) · Zbl 1242.68297
[50] Wang, Y; Zhou, J; Zhou, C; Wang, Y; Qin, H; Youlin, L, An improved self-adaptive PSO technique for short-term hydrothermal scheduling, Expert Syst Appl, 39, 2288-2295, (2012)
[51] Xin J, Chen G, Hai Y (2009) A particle swarm optimizer with multistage linearly-decreasing inertia weight. In: International joint conference on computational sciences and optimization, pp 505-508
[52] Yamaguchi T, Yasuda K (2006) Adaptive particle swarm optimization: self-coordinating mechanism with updating information. In: Proceedings of IEEE international conference on system, man, cybernatics, Taipei, Taiwan, pp 2303-2308
[53] Zhan ZH, Xiao J, Zhang J, Chen WN (2007) Adaptive control of acceleration coefficients for particle swarm optimization based on clustering analysis. In: Proceedings of IEEE congress on evolutionary computation, Singapore, pp 3276-3282
[54] Zhan, Z-H; Zhang, J; Li, Y; etal., Adaptive particle swarm optimization, IEEE Trans Syst Man Cybern Part B Cybern, 39, 1362-1381, (2009)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.