Theory of sequence memory in neocortex (Hawkins & Ahmad 2016)


Hawkins J, Ahmad S. (2016). Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex. Frontiers in neural circuits. 10 [PubMed]

See more from authors: Hawkins J · Ahmad S

References and models cited by this paper

Ahmad S, Billaudelle S. (2016). Porting HTM models to the Heidelberg neuromorphic computing platform.

Antic SD, Zhou WL, Moore AR, Short SM, Ikonomu KD. (2010). The decade of the dendritic NMDA spike. Journal of neuroscience research. 88 [PubMed]

Chklovskii DB, Mel BW, Svoboda K. (2004). Cortical rewiring and information storage. Nature. 431 [PubMed]

Cichon J, Gan WB. (2015). Branch-specific dendritic Ca(2+) spikes cause persistent synaptic plasticity. Nature. 520 [PubMed]

Cover T. (1965). Geometric and statistical properties of systems of linear in-equalities with applications in pattern recognition IEEE Tran Elect Comput. 14

Deneve S. (2008). Bayesian spiking neurons II: learning. Neural computation. 20 [PubMed]

Faisal AA, Selen LP, Wolpert DM. (2008). Noise in the nervous system. Nature reviews. Neuroscience. 9 [PubMed]

Ghosh-Dastidar S, Adeli H. (2009). Spiking neural networks. International journal of neural systems. 19 [PubMed]

Golding NL, Jung HY, Mickus T, Spruston N. (1999). Dendritic calcium spike initiation and repolarization are controlled by distinct potassium channel subtypes in CA1 pyramidal neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 19 [PubMed]

Gütig R, Sompolinsky H. (2006). The tempotron: a neuron that learns spike timing-based decisions. Nature neuroscience. 9 [PubMed]

Haussler D. (1988). Quantifying inductive bias: AI learning algorithms and Valiant’s learning framework Artif.Intell.. 36

Haussler D. (1990). Probably approximately correct learning AAAI-90 Boston MA.

Hawkins J, Ahmad S. (2016). How do neurons operate on sparse distributed representations? A mathematical theory of sparsity, neurons and active dendrites.

Hawkins J, Ahmad S, Cui Y, Surpur C. (2015). .

Hawkins J, Ahmad S, Dubinsky D. (2011). Cortical learning algorithm and hierarchical temporal memory Numenta Whitepaper Availableonline at:http://numenta.org/resources/HTM_CorticalLearningAlgorithms.pdf..

Hawkins J, Blakeslee S. (2004). On Intelligence.

Hochreiter S, Schmidhuber J. (1997). Long short-term memory. Neural computation. 9 [PubMed]

Holtmaat A, Svoboda K. (2009). Experience-dependent structural synaptic plasticity in the mammalian brain. Nature reviews. Neuroscience. 10 [PubMed]

Hu H, Gan J, Jonas P. (2014). Interneurons. Fast-spiking, parvalbumin? GABAergic interneurons: from cellular design to microcircuit function. Science (New York, N.Y.). 345 [PubMed]

Jahnke S, Timme M, Memmesheimer RM. (2015). A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/Ripples. The Journal of neuroscience : the official journal of the Society for Neuroscience. 35 [PubMed]

Kanerva P. (1988). Sparse Distributed Memory.

Kerchner GA, Nicoll RA. (2008). Silent synapses and the emergence of a postsynaptic mechanism for LTP. Nature reviews. Neuroscience. 9 [PubMed]

Knott GW, Quairiaux C, Genoud C, Welker E. (2002). Formation of dendritic spines with GABAergic synapses induced by whisker stimulation in adult mice. Neuron. 34 [PubMed]

Lamme VA, Supèr H, Spekreijse H. (1998). Feedforward, horizontal, and feedback processing in the visual cortex. Current opinion in neurobiology. 8 [PubMed]

Larkum M. (2013). A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex. Trends in neurosciences. 36 [PubMed]

Larkum ME, Nevian T. (2008). Synaptic clustering by dendritic signalling mechanisms. Current opinion in neurobiology. 18 [PubMed]

Larkum ME, Nevian T, Sandler M, Polsky A, Schiller J. (2009). Synaptic integration in tuft dendrites of layer 5 pyramidal neurons: a new unifying principle. Science (New York, N.Y.). 325 [PubMed]

Larkum ME, Zhu JJ, Sakmann B. (1999). A new cellular mechanism for coupling inputs arriving at different cortical layers. Nature. 398 [PubMed]

Lashley KS. (1951). The problem of serial order in behavior Cerebral Mechanismsin Behavior (the Hixon Symposium).

LeCun Y, Bengio Y, Hinton G. (2015). Deep learning. Nature. 521 [PubMed]

Legenstein R, Maass W. (2011). Branch-specific plasticity enables self-organization of nonlinear computation in single neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Leibold C, Kempter R. (2006). Memory capacity for sequences in a recurrent network with biological constraints. Neural computation. 18 [PubMed]

Losonczy A, Makara JK, Magee JC. (2008). Compartmentalized dendritic plasticity and input feature storage in neurons. Nature. 452 [PubMed]

Maass W. (1997). Networks of spiking neurons: The third generation of neural network models Neural Networks. 10

Major G, Larkum ME, Schiller J. (2013). Active properties of neocortical pyramidal neuron dendrites. Annual review of neuroscience. 36 [PubMed]

Major G, Polsky A, Denk W, Schiller J, Tank DW. (2008). Spatiotemporally graded NMDA spike/plateau potentials in basal dendrites of neocortical pyramidal neurons. Journal of neurophysiology. 99 [PubMed]

Martin KA, Schröder S. (2013). Functional heterogeneity in neighboring neurons of cat primary visual cortex in response to both artificial and natural stimuli. The Journal of neuroscience : the official journal of the Society for Neuroscience. 33 [PubMed]

Megías M, Emri Z, Freund TF, Gulyás AI. (2001). Total number and distribution of inhibitory and excitatory synapses on hippocampal CA1 pyramidal cells. Neuroscience. 102 [PubMed]

Memmesheimer RM, Rubin R, Olveczky BP, Sompolinsky H. (2014). Learning precisely timed spikes. Neuron. 82 [PubMed]

Niell CM, Meyer MP, Smith SJ. (2004). In vivo imaging of synapse formation on a growing dendritic arbor. Nature neuroscience. 7 [PubMed]

Nikolić D, Häusler S, Singer W, Maass W. (2009). Distributed fading memory for stimulus properties in the primary visual cortex. PLoS biology. 7 [PubMed]

Olshausen BA, Field DJ. (1997). Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision research. 37 [PubMed]

Olshausen BA, Field DJ. (2004). Sparse coding of sensory inputs. Current opinion in neurobiology. 14 [PubMed]

Petreanu L, Mao T, Sternson SM, Svoboda K. (2009). The subcellular organization of neocortical excitatory connections. Nature. 457 [PubMed]

Poirazi P, Brannon T, Mel BW. (2003). Pyramidal neuron as two-layer neural network. Neuron. 37 [PubMed]

Polsky A, Mel BW, Schiller J. (2004). Computational subunits in thin dendrites of pyramidal cells. Nature neuroscience. 7 [PubMed]

Rabiner L, Juang B. (1986). An introduction to hidden Markov models IEEE ASSP Magazine. 3

Rah JC et al. (2013). Thalamocortical input onto layer 5 pyramidal neurons measured using quantitative large-scale array tomography. Frontiers in neural circuits. 7 [PubMed]

Riedel U, Kühn R, van Hemmen JL. (1988). Temporal sequences and chaos in neural nets. Physical review. A, General physics. 38 [PubMed]

Ruf B, Schmitt M. (1997). Learning temporally encoded patterns in networks of spiking neurons Neural Process. Lett.. 5

Schiller J, Major G, Koester HJ, Schiller Y. (2000). NMDA spikes in basal dendrites of cortical pyramidal neurons. Nature. 404 [PubMed]

Schiller J, Schiller Y. (2001). NMDA receptor-mediated dendritic spikes and coincident signal amplification. Current opinion in neurobiology. 11 [PubMed]

Sejnowski TJ, Rao RPN. (2000). Predictive sequence learning in recurrent neocortical circuits Advances In Neural Information Processing Systems.

Sompolinsky H, Kanter I. (1986). Temporal association in asymmetric neural networks. Physical review letters. 57 [PubMed]

Spruston N. (2008). Pyramidal neurons: dendritic structure and synaptic integration. Nature reviews. Neuroscience. 9 [PubMed]

Stuart GJ, Häusser M. (2001). Dendritic coincidence detection of EPSPs and action potentials. Nature neuroscience. 4 [PubMed]

Thomson AM, Bannister AP. (2003). Interlaminar connections in the neocortex. Cerebral cortex (New York, N.Y. : 1991). 13 [PubMed]

Trachtenberg JT et al. (2002). Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex. Nature. 420 [PubMed]

Vapnik V, Levin E, Cun Y. (6). Measuring the VC-dimension of a learning machine Neural Comput.. 6

Vinje WE, Gallant JL. (2002). Natural stimulation of the nonclassical receptive field increases information transmission efficiency in V1. The Journal of neuroscience : the official journal of the Society for Neuroscience. 22 [PubMed]

Waibel A. (1989). Modular construction of time-delay neural networks for speech recognition Neural Comput.. 1

Wang XJ, Ribary U, Joliot M, Llinás R. (1994). Content and context in temporal thalamocortical binding Temporal Coding in the Brain.

Yen SC, Baker J, Gray CM. (2007). Heterogeneity in the responses of adjacent neurons to natural stimuli in cat striate cortex. Journal of neurophysiology. 97 [PubMed]

Yoshimura Y, Sato H, Imamura K, Watanabe Y. (2000). Properties of horizontal and vertical inputs to pyramidal cells in the superficial layers of the cat visual cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]

References and models that cite this paper

Asabuki T, Fukai T. (2020). Somatodendritic consistency check for temporal feature segmentation. Nature communications. 11 [PubMed]

Bayati M et al. (2018). Storage fidelity for sequence memory in the hippocampal circuit. PloS one. 13 [PubMed]

Bhalla US. (2017). Synaptic input sequence discrimination on behavioral timescales mediated by reaction-diffusion chemistry in dendrites. eLife. 6 [PubMed]

Bono J, Clopath C. (2017). Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level. Nature communications. 8 [PubMed]

Cone I, Shouval HZ. (2021). Learning precise spatiotemporal sequences via biophysically realistic learning rules in a modular, spiking network. eLife. 10 [PubMed]

Poleg-Polsky A. (2019). Dendritic spikes expand the range of well-tolerated population noise structures. The Journal of neuroscience : the official journal of the Society for Neuroscience. 39 [PubMed]

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.