First-Spike-Based Visual Categorization Using Reward-Modulated STDP (Mozafari et al. 2018)


Mozafari M, Kheradpisheh SR, Masquelier T, Nowzari-Dalini A, Ganjtabesh M. (2018). First-Spike-Based Visual Categorization Using Reward-Modulated STDP IEEE Transactions on Neural Networks and Learning Systems.

See more from authors: Mozafari M · Kheradpisheh SR · Masquelier T · Nowzari-Dalini A · Ganjtabesh M

References and models cited by this paper

Arthur J et al. (2011). A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45 nm Proc. IEEE Custom Integr. Circuits Conf. (CICC).

Barto AG, Sutton RS. (1998). Reinforcement Learning (Adaptive Computation and Machine Learning).

Bengio Y, Courbariaux M, David JP. (2015). Binaryconnect: Training deep neural networks with binary weights during propagations Proc. Adv. Neural Inf. Process. Syst..

Bi GQ, Poo MM. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]

Brader JM, Senn W, Fusi S. (2007). Learning real-world stimuli in a neural network with spike-driven synaptic dynamics. Neural computation. 19 [PubMed]

Brette R. (2012). Computing with neural synchrony. PLoS computational biology. 8 [PubMed]

Chen S, Zhao B, Ding R, Tang H, Linares-Barranco B. (2015). Feedforward categorization on AER motion events using cortex-like features in a spiking neural network IEEE Trans. Neural Netw. Learn. Syst.. 26(9)

Cook M et al. (2015). Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing Proc. Int. Joint Conf. Neural Netw. (IJCNN).

Cook M, Thiele J, Diehl PU. (2017). A wake-sleep algorithm for recurrent, spiking neural networks https://arxiv.org/abs/1703.06290.

Daw ND, Doya K. (2006). The computational neurobiology of learning and reward. Current opinion in neurobiology. 16 [PubMed]

Dayan P, Balleine BW. (2002). Reward, motivation, and reinforcement learning. Neuron. 36 [PubMed]

DiCarlo JJ, Cox DD. (2007). Untangling invariant object recognition. Trends in cognitive sciences. 11 [PubMed]

DiCarlo JJ, Zoccolan D, Rust NC. (2012). How does the brain solve visual object recognition? Neuron. 73 [PubMed]

Diehl PU, Cook M. (2015). Unsupervised learning of digit recognition using spike-timing-dependent plasticity. Frontiers in computational neuroscience. 9 [PubMed]

Esser SK et al. (2016). Convolutional networks for fast, energy-efficient neuromorphic computing. Proceedings of the National Academy of Sciences of the United States of America. 113 [PubMed]

Farries MA, Fairhall AL. (2007). Reinforcement learning with modulated spike timing dependent synaptic plasticity. Journal of neurophysiology. 98 [PubMed]

Fergus R, Zeiler MD. (2014). Visualizing and understanding convolutional networks Proc. Eur. Conf. Comput. Vis..

Florian RV. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural computation. 19 [PubMed]

Friedrich J, Urbanczik R, Senn W. (2011). Spatio-temporal credit assignment in neuronal population learning. PLoS computational biology. 7 [PubMed]

Frémaux N, Gerstner W. (2015). Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules. Frontiers in neural circuits. 9 [PubMed]

Frémaux N, Sprekeler H, Gerstner W. (2010). Functional requirements for reward-modulated spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]

Frémaux N, Sprekeler H, Gerstner W. (2013). Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS computational biology. 9 [PubMed]

Fukushima K, Miyake S. (1982). Neocognitron: A self-organizing neural network model for a mechanism of visual pattern recognition Competition Cooperation Neural Nets.

Furber S. (2016). Large-scale neuromorphic computing systems. Journal of neural engineering. 13 [PubMed]

Gerstner W, Kempter R, van Hemmen JL, Wagner H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature. 383 [PubMed]

Gilson M, Masquelier T, Hugues E. (2011). STDP allows fast rate-modulated coding with Poisson-like spike trains. PLoS computational biology. 7 [PubMed]

Glimcher PW. (2011). Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proceedings of the National Academy of Sciences of the United States of America. 108 Suppl 3 [PubMed]

Gu Q. (2002). Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity. Neuroscience. 111 [PubMed]

Guo Y et al. (2017). Timing-dependent LTP and LTD in mouse primary visual cortex following different visual deprivation models. PloS one. 12 [PubMed]

Guyonneau R, VanRullen R, Thorpe SJ. (2005). Neurons tune to the earliest spikes through STDP. Neural computation. 17 [PubMed]

Hinton GE, Krizhevsky A, Sutskever I. (2012). Imagenet classification with deep convolutional neural networks Advances in Neural Information Processing Systems. 25

Hoerzer GM, Legenstein R, Maass W. (2014). Emergence of complex computational structures from chaotic neural networks through reward-modulated Hebbian learning. Cerebral cortex (New York, N.Y. : 1991). 24 [PubMed]

Huang S et al. (2014). Associative Hebbian synaptic plasticity in primate visual cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]

Huerta R, Nowotny T. (2009). Fast and robust learning by reinforcement signals: explorations in the insect brain. Neural computation. 21 [PubMed]

Hung CP, Kreiman G, Poggio T, DiCarlo JJ. (2005). Fast readout of object identity from macaque inferior temporal cortex. Science (New York, N.Y.). 310 [PubMed]

Indiveri G, Pfeiffer M, Binas J. (2016). Deep counter networks for asynchronous event-based processing https://arxiv.org/abs/1611.00710.

Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]

Kheradpisheh SR, Ganjtabesh M, Masquelier T. (2016). Bio-inspired unsupervised learning of visual features leads to robust invariant object recognition Neurocomputing. 205

Kheradpisheh SR, Ganjtabesh M, Thorpe SJ, Masquelier T. (2018). STDP-based spiking deep convolutional neural networks for object recognition. Neural networks : the official journal of the International Neural Network Society. 99 [PubMed]

Kheradpisheh SR, Ghodrati M, Ganjtabesh M, Masquelier T. (2016). Humans and Deep Networks Largely Agree on Which Kinds of Variation Make Object Recognition Harder. Frontiers in computational neuroscience. 10 [PubMed]

Kheradpisheh SR, Ghodrati M, Ganjtabesh M, Masquelier T. (2016). Deep Networks Can Resemble Human Feed-forward Vision in Invariant Object Recognition. Scientific reports. 6 [PubMed]

Krichmar JL, Beyeler M, Dutt ND. (2013). Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule Neural Netw.. 48

Lecun . (1998). Convolutional networks for images, speech, and time series The Handbook of Brain Theory and Neural Networks http://dl.acm.org/citation. cfm?id=303568.303704.

Lee D, Seo H, Jung MW. (2012). Neural basis of reinforcement learning and decision making. Annual review of neuroscience. 35 [PubMed]

Lee H, Ng A, Grosse R, Ranganath R. (2009). Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations Proceedings of the 26th Annual International Conference on Machine Learning (ACM).

Lee JH, Delbruck T, Pfeiffer M. (2016). Training Deep Spiking Neural Networks Using Backpropagation. Frontiers in neuroscience. 10 [PubMed]

Legenstein R, Pecevski D, Maass W. (2008). A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS computational biology. 4 [PubMed]

Liu H, Agam Y, Madsen JR, Kreiman G. (2009). Timing, timing, timing: fast decoding of object information from intracranial field potentials in human visual cortex. Neuron. 62 [PubMed]

Liu SC, Basu A, Hussain S. (2014). Improved margin multi-class classification using dendritic neurons with morphological learning Proc. IEEE Int. Symp. Circuits Syst. (ISCAS).

Maida AS, Masquelier T, Tavanaei A. (2016). Acquisition of visual features through probabilistic spike-timing-dependent plasticity Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN). Jul

Maida AS, Tavanaei A. (2016). Bio-inspired spiking convolutional neural network using layer-wise sparse coding and STDP learning https://arxiv.org/abs/1611.03000.

Marder E. (2012). Neuromodulation of neuronal circuits: back to the future. Neuron. 76 [PubMed]

Markram H, Lübke J, Frotscher M, Sakmann B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science (New York, N.Y.). 275 [PubMed]

Masquelier T. (2018). STDP Allows Close-to-Optimal Spatiotemporal Spike Pattern Detection by Single Coincidence Detector Neurons. Neuroscience. 389 [PubMed]

Masquelier T, Guyonneau R, Thorpe SJ. (2008). Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains. PloS one. 3 [PubMed]

Masquelier T, Thorpe SJ. (2007). Unsupervised learning of visual features through spike timing dependent plasticity. PLoS computational biology. 3 [PubMed]

Meliza CD, Dan Y. (2006). Receptive-field modification in rat visual cortex induced by paired visual stimulation and single-cell spiking. Neuron. 49 [PubMed]

Mnih V et al. (2015). Human-level control through deep reinforcement learning. Nature. 518 [PubMed]

Nadim F, Bucher D. (2014). Neuromodulation of neurons and synapses. Current opinion in neurobiology. 29 [PubMed]

Neftci E, Das S, Pedroni B, Kreutz-Delgado K, Cauwenberghs G. (2013). Event-driven contrastive divergence for spiking neuromorphic systems. Frontiers in neuroscience. 7 [PubMed]

Niv Y. (2009). Reinforcement learning in the brain J. Math. Psychol.. 53(3)

O'Connor P, Neil D, Liu SC, Delbruck T, Pfeiffer M. (2013). Real-time classification and sensor fusion with a spiking deep belief network. Frontiers in neuroscience. 7 [PubMed]

Pavlov IP, Anrep GV. (2003). Conditioned Reflexes.

Ponulak F, Kasiński A. (2010). Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting. Neural computation. 22 [PubMed]

Querlioz D, Bichler O, Dollfus P, Gamrat C. (2013). Immunity to device variations in a spiking neural network with memristive nanodevices IEEE Trans. Nanotechnol.. 12(3)

Reynolds JN, Wickens JR. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]

Rueckauer B, Lungu IA, Hu Y, Pfeiffer M, Liu SC. (2017). Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification. Frontiers in neuroscience. 11 [PubMed]

Schultz W. (1998). Predictive reward signal of dopamine neurons. Journal of neurophysiology. 80 [PubMed]

Schultz W. (2002). Getting formal with dopamine and reward. Neuron. 36 [PubMed]

Schultz W. (2015). Neuronal Reward and Decision Signals: From Theories to Data. Physiological reviews. 95 [PubMed]

Seol GH et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron. 55 [PubMed]

Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T. (2007). Robust object recognition with cortex-like mechanisms. IEEE transactions on pattern analysis and machine intelligence. 29 [PubMed]

Silver D et al. (2016). Mastering the game of Go with deep neural networks and tree search. Nature. 529 [PubMed]

Sjöström PJ, Turrigiano GG, Nelson SB. (2001). Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron. 32 [PubMed]

Song S, Miller KD, Abbott LF. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature neuroscience. 3 [PubMed]

Sporea I, Gardner B, Gru¨ning A. (2014). Classifying spike patterns by reward-modulated STDP Proc. Int. Conf. Artif. Neural Netw..

Steinberg EE et al. (2013). A causal link between prediction errors, dopamine neurons and learning. Nature neuroscience. 16 [PubMed]

Thorndike EL. (1898). Review of animal intelligence: An experimental study of the associative processes in animals Psychol. Rev.. 5(5)

Thorpe S, Fize D, Marlot C. (1996). Speed of processing in the human visual system. Nature. 381 [PubMed]

Thorpe S, Imbert M. (1989). Biological constraints on connectionist modelling. Connectionism in Perspective..

VanRullen R, Thorpe SJ. (2002). Surfing a spike wave down the ventral stream. Vision research. 42 [PubMed]

Vasilaki E, Frémaux N, Urbanczik R, Senn W, Gerstner W. (2009). Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS computational biology. 5 [PubMed]

Welling M, O'Connor P. (2016). Deep spiking networks https://arxiv.org/abs/1602.08323.

Yu Q, Tang H, Tan KC, Li H. (2013). Rapid feedforward computation by temporal encoding and learning with spiking neurons. IEEE transactions on neural networks and learning systems. 24 [PubMed]

Zhang JC, Lau PM, Bi GQ. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proceedings of the National Academy of Sciences of the United States of America. 106 [PubMed]

Zisserman A, Simonyan K. (2014). Very deep convolutional networks for large-scale image recognition https://arxiv.org/abs/1409.1556.

References and models that cite this paper

Masquelier T, Saeed Reza. (2018). Optimal localist and distributed coding of spatiotemporal spike patterns through STDP and coincidence detection Front. Comput. Neurosci..

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.