×

zbMATH — the first resource for mathematics

Pipelining of Fuzzy ARTMAP without matchtracking: Correctness, performance bound, and Beowulf evaluation. (English) Zbl 1158.68442
Summary: Fuzzy ARTMAP neural networks have been proven to be good classifiers on a variety of classification problems. However, the time that Fuzzy ARTMAP takes to converge to a solution increases rapidly as the number of patterns used for training is increased. In this paper we examine the time Fuzzy ARTMAP takes to converge to a solution and we propose a coarse grain parallelization technique, based on a pipeline approach, to speed-up the training process. In particular, we have parallelized Fuzzy ARTMAP without the match-tracking mechanism. We provide a series of theorems and associated proofs that show the characteristics of Fuzzy ARTMAP’s, without matchtracking, parallel implementation. Results run on a BEOWULF cluster with three large databases show linear speedup as a function of the number of processors used in the pipeline. The databases used for our experiments are the Forrest CoverType database from the UCI Machine Learning repository and two artificial databases, where the data generated were 16-dimensional Gaussian distributed data belonging to two distinct classes, with different amounts of overlap (5% and 15%).
MSC:
68T05 Learning and adaptive systems in artificial intelligence
68T10 Pattern recognition, speech recognition
Software:
UCI-ml; SLIQ; C4.5; SPRINT
PDF BibTeX Cite
Full Text: DOI
References:
[1] Agrawal, R.; Srikant, R., Fast algorithms for mining association rules in large databases, (), 487-499
[2] Anagnostopoulos, G. (2000). Novel approaches in adaptive resonance theory for machine learning. Unpublished doctoral dessertation. Computer Engineering, UCF
[3] Anagnostopoulos, G.C.; Georgiopoulos, M., (), 1221-1226
[4] Anagnostopoulos, G.C., & Georgiopoulos, M. (2003). Putting the utility of match tracking in Fuzzy ARTMAP training to the test. In Seventh international conference on knowledge-based intelligent information and engineering systems
[5] Asanović, K.; Beck, J.; Kingsbury, B.; Morgan, N.; Johnson, D.; Wawrzynek, J., Training neural networks with SPERT-II, ()
[6] Blackard, J. A. (1999). Comparison of neural networks and discriminant analysis in predicting forest cover types. Unpublished doctoral dessertation. Department of Forest Sciences, Colorado State University
[7] Carpenter, G.A.; Grossberg, S.; Markuzon, N.; Reynolds, J.H.; Rosen, D.B., Fuzzy ARTMAP: A neural network architecture for incremental learning of analog multidimensional maps, IEEE transactions on neural networks, 3, 5, 698-713, (1992)
[8] Carpenter, G.A.; Grossberg, S.; Reynolds, J.H., (), 411-416
[9] Carpenter, G.A.; Markuzon, N., ARTMAP-IC and medical diagnosys: instance counting and inconsistent cases, Neural networks, 11, 793-813, (1998)
[10] Carpenter, G.A.; Ross, W.D., ART-EMAP: A neural network architecture for object recognition by evidence accumulation, IEEE transactions on neural networks, 6, 5, 805-818, (1995)
[11] Caudell, T.P.; Healy, M.J., (), 1979-1982
[12] Kasuba, T., Simplified fuzzy ARTMAP, AI expert, 18-25, (1993)
[13] King, R.; Feng, C.; Shutherland, A., STATLOG: comparison of classification algorithms on large real-world problems, Applied artificial intelligence, 9, 3, 259-287, (1995)
[14] Kirkpatrick, S.; Stoll, E., A very fast shift-register sequence random number generator, Journal of computational physics, 40, 517-526, (1981) · Zbl 0458.65003
[15] Malkani, A.; Vassiliadis, C.A., Parallel implementation of the fuzzy ARTMAP neural network paradigm on a hypercube, Expert systems, 12, 1, 39-53, (1995)
[16] Mangasarian, O.; Solodov, M., Serial and parallel backpropagation convergence via nonmonotone perturbed minimization, Optimization methods and software, 4, 2, 103-116, (1994)
[17] Manolakos, E.S., Parallel implementation of ART1 neural networks on processor ring architectures, ()
[18] Mehta, M.; Agrawal, R.; Rissanen, J., SLIQ: A fast scalable classifier for data mining, (), 18-32
[19] Petridis, V.; Kaburlasos, V.G.; Fragkou, V.G.; Kehagais, A., (), 1362-1367
[20] Quinlan, J.R., C4.5: programs for machine learning, (1993), Morgan Kaufmann San Mateo, California
[21] Rumelhart, D.E.; Hinton, G.E.; Williams, R.J., Learning internal representations by error propagation, (), 318-362
[22] Shafer, J.C.; Agrawal, R.; Mehta, M., VLDB, SPRINT: A scalable parallel classifier for data mining, (), 544-555
[23] Simpson, P.K., Fuzzy min – max neural networks – part 1: classification, IEEE transactions on neural networks, 3, 5, 776-786, (1992)
[24] Taghi, M.; Baghmisheh, V.; Pavesic, N., A fast simplified fuzzy ARTMAP network, Neural processing letters, 17, 273-316, (2003)
[25] Torresen, J., Nakashima, H., Tomita, S., & Landsverk, O. (1995). General mapping of feed-forward neural networks onto an MIMD computer. In Proceedings of the IEEE international conference on neural networks
[26] Torresen, J.; Tomita, S., (), 41-118
[27] University of California, Irvine (2003). UCI machine learning repository. http://www.icf.uci.edu/mlearn/MLRepository.html
[28] Williamson, J.R., Gaussian ARTMAP: A neural network for fast incremental learning of noisy multidimensional maps, Neural networks, 9, 5, 881-897, (1996)
[29] Zhang, D., Parallel VLSI neural systems design, (1998), Springer · Zbl 0928.68089
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.