×

zbMATH — the first resource for mathematics

Coincidence detection using spiking neurons with application to face recognition. (English) Zbl 1386.68132
Summary: We elucidate the practical implementation of Spiking Neural Network (SNN) as local ensembles of classifiers. Synaptic time constant \(\tau_s\) is used as learning parameter in representing the variations learned from a set of training data at classifier level. This classifier uses coincidence detection (CD) strategy trained in supervised manner using a novel supervised learning method called \(\tau_s\) Prediction which adjusts the precise timing of output spikes towards the desired spike timing through iterative adaptation of \(\tau_s\). This paper also discusses the approximation of spike timing in Spike Response Model (SRM) for the purpose of coincidence detection. This process significantly speeds up the whole process of learning and classification. Performance evaluations with face datasets such as AR, FERET, JAFFE, and CK+ datasets show that the proposed method delivers better face classification performance than the network trained with Supervised Synaptic-Time Dependent Plasticity (STDP). We also found that the proposed method delivers better classification accuracy than \(k\) nearest neighbor, ensembles of \(k\)NN, and Support Vector Machines. Evaluation on several types of spike codings also reveals that latency coding delivers the best result for face classification as well as for classification of other multivariate datasets.
MSC:
68T05 Learning and adaptive systems in artificial intelligence
68T10 Pattern recognition, speech recognition
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Roy, S. A.; Alloway, K. D., Coincidence detection or temporal integration? What the neurons in somatosensory cortex are doing, The Journal of Neuroscience, 21, 7, 2462-2473, (2001)
[2] Carlton, J. G.; Cullen, P. J., Coincidence detection in phosphoinositide signaling, Trends in Cell Biology, 15, 10, 540-547, (2005)
[3] Tabone, C. J.; Ramaswami, M., Is NMDA receptor-coincidence detection required for learning and memory?, Neuron, 74, 5, 767-769, (2012)
[4] Maass, W.; Maass, W.; Bishop, C. M., Computing with spiking neurons, Pulsed Neural Network, 55-85, (1999), Cambridge, Mass, USA: MIT Press, Cambridge, Mass, USA
[5] Sporea, I.; Grüning, A., Supervised learning in multilayer spiking neural networks, Neural Computation, 25, 2, 473-509, (2013) · Zbl 1269.68083
[6] Abeles, M., Role of the cortical neuron: integrator or coincidence detector?, Israel Journal of Medical Sciences, 18, 1, 83-92, (1982)
[7] König, P.; Engel, A. K.; Singer, W., Integrator or coincidence detector? The role of the cortical neuron revisited, Trends in Neurosciences, 19, 4, 130-137, (1996)
[8] DeCharms, R. C.; Zador, A., Neural representation and the cortical code, Annual Review of Neuroscience, 23, 613-647, (2000)
[9] Usrey, W. M.; Alonso, J. M.; Reid, R. C., Synaptic interactions between thalamic inputs to simple cells in cat visual cortex, The Journal of Neuroscience, 20, 14, 5461-5467, (2000)
[10] Chen, Y.; Zhang, H.; Wang, H.; Yu, L., The role of coincidence-detector neurons in the reliability and precision of subthreshold signal detection in noise, PLoS ONE, 8, 2, (2013)
[11] Bohte, S. M.; Kok, J. N.; Poutre, H. L., SpikeProp: backpropagation for networks of spiking neurons, Proceedings of the 8th European Symposium on Artificial Neural Networks (ESANN ’00)
[12] Bohte, S. M.; Kok, J. N.; Poutré, H. L., Error-backpropagation in temporally encoded networks of spiking neurons, Neurocomputing, 48, 17-37, (2002) · Zbl 1006.68760
[13] Ponulak, F., ReSuMe—New Supervised Learning Method for Spiking Neural Networks, (2005), Institute of Control and Information Engineering, Poznan University of Technology
[14] Florian, R. V., The chronotron: a neuron that learns to fire temporally precise spike patterns, PLoS ONE, 7, 8, (2012)
[15] Xu, Y.; Zeng, X.; Han, L.; Yang, J., A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks, Neural Networks, 43, 99-113, (2013) · Zbl 1321.92040
[16] Mohemmed, A.; Schliebs, S.; Matsuda, S.; Kasabov, N., Training spiking neural networks to associate spatio-temporal input-output spike patterns, Neurocomputing, 107, 3-10, (2013)
[17] Pfister, J.-P.; Barber, D.; Gerstner, W., Optimal hebbian learning: a probabilistic point of view, Artificial Neural Networks and Neural Information Processing—ICANN/ICONIP 2003. Artificial Neural Networks and Neural Information Processing—ICANN/ICONIP 2003, Lecture Notes in Computer Science, 2714, 92-98, (2003), Berlin, Germany: Springer, Berlin, Germany · Zbl 1037.68707
[18] Pfister, J.-P.; Toyoizumi, T.; Barber, D.; Gerstner, W., Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning, Neural Computation, 18, 6, 1318-1348, (2006) · Zbl 1092.92008
[19] Carnell, A.; Richardson, D., Linear algebra for time series of spikes, Proceedings of the 13th European Symposium on Artificial Neural Networks
[20] Belatreche, A.; Maguire, L. P.; McGinnity, M.; Wu, Q. X., A method for supervised training of spiking neural networks, Proceedings of the IEEE Cybernetics Intelligence—Challenges and Advances (CICA ’03)
[21] Schrauwen, B., Towards applicable spiking neural networks [Doctorate], (2008), Ghent, Belgium: Electronics and Information Systems, Ghent University, Ghent, Belgium
[22] Gerstner, W.; Kistler, W. M., Spiking Neuron Models, (2002), Cambridge, UK: Cambridge University Press, Cambridge, UK · Zbl 1100.92501
[23] Gerstner, W.; Kistler, W. M., Mathematical formulations of Hebbian learning, Biological Cybernetics, 87, 5-6, 404-415, (2002) · Zbl 1105.92313
[24] Abbott, L. F.; Nelson, S. B., Synaptic plasticity: taming the beast, Nature Neuroscience, 3, 1178-1183, (2000)
[25] Song, S.; Miller, K. D.; Abbott, L. F., Competitive Hebbian learning through spike-timing-dependent synaptic plasticity, Nature Neuroscience, 3, 9, 919-926, (2000)
[26] Makino, T., A discrete-event neural network simulator for general neuron models, Neural Computing & Applications, 11, 3-4, 210-223, (2003) · Zbl 1040.68101
[27] Brette, R., Exact simulation of integrate-and-fire models with synaptic conductances, Neural Computation, 18, 8, 2004-2027, (2006) · Zbl 1121.92012
[28] Sporea, I.; Grüning, A., Reference time in SpikeProp, Proceedings of the International Joint Conference on Neural Network (IJCNN ’11)
[29] Zaman, F. K.; Shafie, A. A.; Mustafah, Y. M., Face recognition robust against expressions and partial occlusions
[30] Tan, X.; Chen, S.; Zhou, Z.-H.; Zhang, F., Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft κ-NN ensemble, IEEE Transactions on Neural Networks, 16, 4, 875-886, (2005)
[31] Tan, X.; Chen, S.; Zhou, Z.-H.; Zhang, F., Face recognition from a single image per person: a survey, Pattern Recognition, 39, 9, 1725-1745, (2006) · Zbl 1096.68732
[32] Martinez, A. M.; Benavente, R., The AR face database, CVC Technical Report, 24, (1998), Purdue University
[33] Lyons, M. J.; Kamachi, M.; Gyoba, J., Japanese Female Facial Expressions (JAFFE), Database of Digital Images, (1997)
[34] Jonathon Phillips, P.; Moon, H.; Rizvi, S. A.; Rauss, P. J., The FERET evaluation methodology for face-recognition algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 10, 1090-1104, (2000)
[35] Lucey, P.; Cohn, J. F.; Kanade, T.; Saragih, J.; Ambadar, Z.; Matthews, I., The Extended Cohn-Kanade Dataset (CK+): a complete dataset for action unit and emotion-specified expression, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW ’10)
[36] Nordlie, E.; Gewaltig, M.-O.; Plesser, H. E., Towards reproducible descriptions of neuronal network models, PLoS Computational Biology, 5, 8, (2009)
[37] Su, Y.; Shan, S.; Chen, X.; Gao, W., Hierarchical ensemble of global and local classifiers for face recognition, IEEE Transactions on Image Processing, 18, 8, 1885-1896, (2009) · Zbl 1371.94355
[38] Chang, C.-C.; Lin, C.-J., LIBSVM: a Library for support vector machines, ACM Transactions on Intelligent Systems and Technology, 2, 3, article 27, (2011)
[39] Bache, K.; Lichman, M., UCI Machine Learning Repository, (2013), Irvine, Calif, USA: University of California, School of Information and Computer Sciences, Irvine, Calif, USA
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.