zbMATH — the first resource for mathematics

A neural network model for familiarity and context learning during honeybee foraging flights. (English) Zbl 1400.92609
Summary: How complex is the memory structure that honeybees use to navigate? Recently, an insect-inspired parsimonious spiking neural network model was proposed that enabled simulated ground-moving agents to follow learned routes. We adapted this model to flying insects and evaluate the route following performance in three different worlds with gradually decreasing object density. In addition, we propose an extension to the model to enable the model to associate sensory input with a behavioral context, such as foraging or homing. The spiking neural network model makes use of a sparse stimulus representation in the mushroom body and reward-based synaptic plasticity at its output synapses. In our experiments, simulated bees were able to navigate correctly even when panoramic cues were missing. The context extension we propose enabled agents to successfully discriminate partly overlapping routes. The structure of the visual environment, however, crucially determines the success rate. We find that the model fails more often in visually rich environments due to the overlap of features represented by the Kenyon cell layer. Reducing the landmark density improves the agents route following performance. In very sparse environments, we find that extended landmarks, such as roads or field edges, may help the agent stay on its route, but often act as strong distractors yielding poor route following performance. We conclude that the presented model is valid for simple route following tasks and may represent one component of insect navigation. Additional components might still be necessary for guidance and action selection while navigating along different memorized routes in complex natural environments.
92D50 Animal behavior
92B20 Neural networks for/in biological studies, artificial life and related topics
Full Text: DOI
[1] Ardin P, Peng F, Mangan M, Lagogiannis K, Webb B (2016) Using an insect mushroom body circuit to encode route memory in complex natural environments. PLoS Comput Biol 12(2):e1004,683
[2] Asahina, K; Louis, M; Piccinotti, S; Vosshall, LB, A circuit supporting concentration-invariant odor perception in drosophila, J Biol, 8, 9, (2009)
[3] Aso, Y; Sitaraman, D; Ichinose, T; Kaun, KR; Vogt, K; Belliart-Guérin, G; Plaçais, PY; Robie, AA; Yamagata, N; Schnaitmann, C; etal., Mushroom body output neurons encode valence and guide memory-based action selection in drosophila, Elife, 3, 580, (2014)
[4] Avarguès-Weber A, Giurfa M (2013) Conceptual learning by miniature brains. Proc R Soc Lond B Biol Sci 280(1772):20131,907
[5] Baddeley B, Graham P, Husbands P, Philippides A (2012) A model of ant route navigation driven by scene familiarity. PLoS Comput Biol 8(1):e1002,336. doi:10.1371/journal.pcbi.1002336
[6] Bazhenov, M; Huerta, R; Smith, BH, A computational framework for understanding decision making through integration of basic learning rules, J Neurosci, 33, 5686-5697, (2013)
[7] Capaldi, EA; Smith, AD; Osborne, JL; Fahrbach, SE; etal., Ontogeny of orientation flight in the honeybee revealed by harmonic radar, Nature, 403, 537, (2000)
[8] Caron, SJ; Ruta, V; Abbott, L; Axel, R, Random convergence of olfactory inputs in the drosophila mushroom body, Nature, 497, 113-117, (2013)
[9] Cassenaer, S; Laurent, G, Corrigendum: conditional modulation of spike-timing-dependent plasticity for olfactory learning, Nature, 487, 128-128, (2012)
[10] Cheeseman, JF; Millar, CD; Greggers, U; Lehmann, K; Pawley, MDM; Gallistel, CR; Warman, GR; Menzel, R, Way-finding in displaced clock-shifted bees proves bees use a cognitive map, Proc Natl Acad Sci, 111, 8949-8954, (2014)
[11] Cheung A, Collett M, Collett TS, Dewar A, Dyer F, Graham P, Mangan M, Narendra A, Philippides A, Stürzl W, Webb B, Wystrach A, Zeil J (2014) Still no convincing evidence for cognitive map use by honeybees: Fig. 1. Proc Natl Acad Sci 111(42):E4396-E4397. doi:10.1073/pnas.1413581111
[12] Collett, TS; Collett, M, Memory use in insect visual navigation, Nat Rev Neurosci, 3, 542-552, (2002)
[13] Cruse H, Wehner R (2011) No need for a cognitive map: decentralized memory for insect navigation. PLoS Comput Biol 7(3):e1002,009. doi:10.1371/journal.pcbi.1002009
[14] Devaud, JM; Papouin, T; Carcaud, J; Sandoz, JC; Grünewald, B; Giurfa, M, Neural substrate for higher-order learning in an insect: mushroom bodies are necessary for configural discriminations, Proc Natl Acad Sci, 112, e5854-e5862, (2015)
[15] Dylla, KV; Raiser, G; Galizia, CG; Szyszka, P, Trace conditioning in drosophila induces associative plasticity in mushroom body kenyon cells and dopaminergic neurons, Front Neural Circuits, 11, 42, (2017)
[16] Farkhooi F, Froese A, Muller E, Menzel R, Nawrot MP (2013) Cellular adaptation facilitates sparse and reliable coding in sensory pathways. PLoS Comput Biol 9(10):e1003,251
[17] Fernandez PC, Locatelli FF, Person-Rennell N, Deleo G, Smith BH (2009) Associative conditioning tunes transient dynamics of early olfactory processing. J Neurosci 29(33):10,191-10,202
[18] Filla, I; Menzel, R, Mushroom body extrinsic neurons in the honeybee (apis mellifera) brain integrate context and cue values upon attentional stimulus selection, J Neurophysiol, 114, 2005-2014, (2015)
[19] Gupta, N; Stopfer, M, Functional analysis of a higher olfactory center, the lateral Horn, J Neurosci, 32, 8138-8148, (2012)
[20] Haehnel, M; Menzel, R, Sensory representation and learning-related plasticity in mushroom body extrinsic feedback neurons of the protocerebral tract, Front Syst Neurosci, 4, 161, (2010)
[21] Haenicke J (2015) Modeling insect inspired mechanisms of neural and behavioral plasticity. PhD thesis, Freie Universität Berlin
[22] Hausler C, Nawrot MP, Schmuker M (2011) A spiking neuron classifier network with a deep architecture inspired by the olfactory system of the honeybee. In: 5th International IEEE/EMBS conference on neural engineering (NER), pp 198-202
[23] Heisenberg, M, Mushroom body memoir: from maps to models, Nat Rev Neurosci, 4, 266-275, (2003)
[24] Helgadottir LI, Haenicke J, Landgraf T, Rojas R, Nawrot MP (2013) Conditioned behavior in a robot controlled by a spiking neural network. In: 6th International IEEE/EMBS conference on neural engineering (NER), 2013, pp 891-894
[25] Hige, T; Aso, Y; Rubin, GM; Turner, GC, Plasticity-driven individualization of olfactory coding in mushroom body output neurons, Nature, 526, 258-262, (2015)
[26] Honegger KS, Campbell RA, Turner GC (2011) Cellular-resolution population imaging reveals robust sparse coding in the drosophila mushroom body. J Neurosci 31(33):11,772-11,785
[27] Hope, ACA, A simplified Monte Carlo significance test procedure, J Roy Stat Soc B, 30, 582-98, (1968) · Zbl 0187.15901
[28] Huerta, R; Nowotny, T, Fast and robust learning by reinforcement signals: explorations in the insect brain, Neural Comput, 21, 2123-2151, (2009) · Zbl 1176.68181
[29] Huerta, R; Nowotny, T; García-Sanchez, M; Abarbanel, HD; Rabinovich, MI, Learning classification in the olfactory system of insects, Neural Comput, 16, 1601-1640, (2004) · Zbl 1053.92011
[30] Hurley, N; Rickard, S, Comparing measures of sparsity, IEEE Trans Inf Theory, 55, 4723-4741, (2009) · Zbl 1367.94094
[31] Ito I, Ong RCy, Raman B, Stopfer M, (2008) Sparse odor representation and olfactory learning. Nat Neurosci 11(10):1177-1184
[32] Izhikevich, EM, Solving the distal reward problem through linkage of STDP and dopamine signaling, Cereb Cortex, 17, 2443-2452, (2007)
[33] Jacobs, LF; Menzel, R, Navigation outside of the box: what the lab can learn from the field and what the field can learn from the lab, Mov Ecol, 2, 3, (2014)
[34] Jortner, RA; Farivar, SS; Laurent, G, A simple connectivity scheme for sparse coding in an olfactory system, J Neurosci, 27, 1659-1669, (2007)
[35] Kee T, Sanda P, Gupta N, Stopfer M, Bazhenov M (2015) Feed-forward versus feedback inhibition in a basic olfactory circuit. PLoS Comput Biol 11(10):e1004,531
[36] Kloppenburg, P; Nawrot, MP, Neural coding: sparse but on time, Curr Biol, 24, r957-r959, (2014)
[37] Laughlin, SB; Horridge, GA, Angular sensitivity of the retinula cells of dark-adapted worker bee, Zeitschrift für Vergleichende Physiologie, 74, 329-335, (1971)
[38] Lengler J, Jug F, Steger A (2013) Reliable neuronal systems: the importance of heterogeneity. PLoS ONE 8(12):e80,694
[39] Menzel, R, The honeybee as a model for understanding the basis of cognition, Nat Rev Neurosci, 13, 758-768, (2012)
[40] Menzel, R, The insect mushroom body, an experience-dependent recoding device, J Physiol Paris, 108, 84-95, (2014)
[41] Menzel, R; Giurfa, M, Cognitive architecture of a mini-brain: the honeybee, Trends Cogn Sci, 5, 62-71, (2001)
[42] Menzel, R; Greggers, U, The memory structure of navigation in honeybees, J Comp Physiol A Neuroethol Sens Neural Behav Physiol, 201, 547-61, (2015)
[43] Menzel, R; Manz, G, Neural plasticity of mushroom body-extrinsic neurons in the honeybee brain, J Exp Biol, 208, 4317-32, (2005)
[44] Menzel, R; Kirbach, A; Haass, WD; Fischer, B; Fuchs, J; Koblofsky, M; Lehmann, K; Reiter, L; Meyer, H; Nguyen, H; Jones, S; Norton, P; Greggers, U, A common frame of reference for learned and communicated vectors in honeybee navigation, Curr Biol, 21, 645-650, (2011)
[45] Montero, A; Huerta, R; Rodriguez, FB, Regulation of specialists and generalists by neural variability improves pattern recognition performance, Neurocomputing, 151, 69-77, (2015)
[46] Morrison, A; Diesmann, M; Gerstner, W, Phenomenological models of synaptic plasticity based on spike timing, Biol Cybern, 98, 459-478, (2008) · Zbl 1145.92306
[47] Nadim, F; Bucher, D, Neuromodulation of neurons and synapses, Curr Opin Neurobiol, 29, 48-56, (2014)
[48] Nawrot, MP, Dynamics of sensory processing in the dual olfactory pathway of the honeybee, Apidologie, 43, 269-291, (2012)
[49] Nowotny T, Huerta R (2012) On the equivalence of Hebbian learning and the SVM formalism. In: 46th annual conference on information sciences and systems (CISS), 2012, pp 1-4
[50] Nowotny, T; Huerta, R; Abarbanel, HD; Rabinovich, MI, Self-organization in the olfactory system: one shot odor recognition in insects, Biol Cybern, 93, 436-446, (2005) · Zbl 1132.92321
[51] Olsen, SR; Wilson, RI, Lateral presynaptic inhibition mediates gain control in an olfactory circuit, Nature, 452, 956-960, (2008)
[52] Perez-Orive, J; Mazor, O; Turner, GC; Cassenaer, S; Wilson, RI; Laurent, G, Oscillations and sparsening of odor representations in the mushroom body, Science, 297, 359-365, (2002)
[53] Riley, JR; Greggers, U; Smith, AD; Reynolds, DR; Menzel, R, The flight paths of honeybees recruited by the waggle dance, Nature, 435, 205, (2005)
[54] Schmuker M, Yamagata N, Nawrot M, M R, (2011) Parallel representation of stimulus identity and intensity in a dual pathway model inspired by the olfactory system of the honeybee. Front Neuroeng 4:17
[55] Schmuker, M; Pfeil, T; Nawrot, MP, A neuromorphic network for generic multivariate data classification, Proc Natl Acad Sci, 111, 2081-2086, (2014)
[56] Schwaerzel M, Monastirioti M, Scholz H, Friggi-Grelin F, Birman S, Heisenberg M (2003) Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in drosophila. J Neurosci 23(33):10,495-10,502
[57] Seelig, JD; Jayaraman, V, Neural dynamics for landmark orientation and angular path integration, Nature, 521, 186-191, (2015)
[58] Serrano E, Nowotny T, Levi R, Smith BH, Huerta R (2013) Gain control network conditions in early sensory coding. PLoS Comput Biol 9(7):e1003,133
[59] Smith BH, Huerta R, Bazhenov M, Sinakevitch I (2012) Distributed plasticity for olfactory learning and memory in the honey bee brain. In: Honeybee neurobiology and behavior, Springer, pp 393-408
[60] Srinivasan, MV, Going with the flow: a brief history of the study of the honeybee’s navigational odometer’, J Comp Physiol A, 200, 563-573, (2014)
[61] Strube-Bloss, MF; Nawrot, MP; Menzel, R, Mushroom body output neurons encode odor-reward associations, J Neurosci, 31, 3129-3140, (2011)
[62] Strube-Bloss MF, Nawrot MP, Menzel R (2016) Neural correlates of side-specific odour memory in mushroom body output neurons. Proc R Soc B 283(1844):20161,270
[63] Stürzl, W; Zeil, J, Depth, contrast and view-based homing in outdoor scenes, Biol Cybern, 96, 519-531, (2007) · Zbl 1172.91339
[64] Stürzl W, Böddeker N, Dittmar L, Egelhaaf M (2010) Mimicking honeybee eyes with a 280 field of view catadioptric imaging system. Bioinspir Biomim 5(3):036,002
[65] Szyszka, P; Ditzen, M; Galkin, A; Galizia, CG; Menzel, R, Sparsening and temporal sharpening of olfactory representations in the honeybee mushroom bodies, J Neurophysiol, 94, 3303-3313, (2005)
[66] Szyszka, P; Galkin, A; Menzel, R, Associative and non-associative plasticity in kenyon cells of the honeybee mushroom body, Front Syst Neurosci, 2, 3, (2008)
[67] Tolman, EC, Cognitive maps in rats and men, Psychol Rev, 55, 189, (1948)
[68] Turner GC, Bazhenov M, Laurent G (2008) Olfactory representations by. J Neurophysiol, pp 734-746. doi:10.1152/jn.01283.2007
[69] Vitay J, Dinkelbach HÜ, Hamker FH (2015) ANNarchy: a code generation approach to neural simulations on parallel hardware. Front Neuroinform 9:19. doi:10.3389/fninf.2015.00019
[70] von Frisch K (1967) The dance language and orientation of bees. Harvard University Press, Harvard
[71] Wessnitzer, J; Young, JM; Armstrong, JD; Webb, B, A model of non-elemental olfactory learning in drosophila, J Comput Neurosci, 32, 197-212, (2012)
[72] Wilson, RI; Laurent, G, Role of gabaergic inhibition in shaping odor-evoked spatiotemporal patterns in the drosophila antennal lobe, J Neurosci, 25, 9069-9079, (2005)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.