Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)


Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW. (2013). Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural computation. 25 [PubMed]

See more from authors: Neymotin SA · Chadderdon GL · Kerr CC · Francis JT · Lytton WW

References and models cited by this paper

Afshar A et al. (2011). Single-trial neural correlates of arm movement preparation. Neuron. 71 [PubMed]

Almássy N, Edelman GM, Sporns O. (1998). Behavioral constraints in the development of neuronal properties: a cortical model embedded in a real-world device. Cerebral cortex (New York, N.Y. : 1991). 8 [PubMed]

Bannister AP. (2005). Inter- and intra-laminar connections of pyramidal cells in the neocortex. Neuroscience research. 53 [PubMed]

Bedau MA. (2005). Artificial life: more than just building and studying computational systems. Artificial life. 11 [PubMed]

Berthier N. (2011). The syntax of human infant reaching 8th International Conference on Complex Systems.

Berthier NE, Clifton RK, McCall DD, Robin DJ. (1999). Proximodistal structure of early reaching in human infants. Experimental brain research. 127 [PubMed]

Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW. (2012). Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex. PloS one. 7 [PubMed]

Cools R. (2006). Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neuroscience and biobehavioral reviews. 30 [PubMed]

Corbetta D, Snapp-Childs W. (2009). Seeing and touching: the role of sensory-motor experience on the development of infant reaching. Infant behavior & development. 32 [PubMed]

De Schutter E. (2008). Why are computational neuroscience and systems biology so separate? PLoS computational biology. 4 [PubMed]

Dyhrfjeld-Johnsen J et al. (2007). Topological determinants of epileptogenesis in large-scale structural and functional models of the dentate gyrus derived from experimental data. Journal of neurophysiology. 97 [PubMed]

Edelman GM. (1987). Neural Darwinism: The Theory of Neural Group Selection.

Edelman GM. (2004). Wider than the sky: The phenomenal gift of consciousness.

Evans RC et al. (2012). The effects of NMDA subunit composition on calcium influx and spike timing-dependent plasticity in striatal medium spiny neurons. PLoS computational biology. 8 [PubMed]

Farries MA, Fairhall AL. (2007). Reinforcement learning with modulated spike timing dependent synaptic plasticity. Journal of neurophysiology. 98 [PubMed]

Fenton AA et al. (2010). Attention-like modulation of hippocampus place cell discharge. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]

Florian RV. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural computation. 19 [PubMed]

Frank MJ, O'Reilly RC. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behavioral neuroscience. 120 [PubMed]

Frank MJ, Seeberger LC, O'reilly RC. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science (New York, N.Y.). 306 [PubMed]

Gourévitch B, Eggermont JJ. (2007). Evaluating information transfer between auditory cortical neurons. Journal of neurophysiology. 97 [PubMed]

Graybiel AM, Aosaki T, Flaherty AW, Kimura M. (1994). The basal ganglia and adaptive motor control. Science (New York, N.Y.). 265 [PubMed]

Hikosaka O, Nakamura K, Sakai K, Nakahara H. (2002). Central mechanisms of motor skill learning. Current opinion in neurobiology. 12 [PubMed]

Hines ML, Carnevale NT. (2006). The NEURON Book.

Hosp JA, Pekanovic A, Rioult-Pedotti MS, Luft AR. (2011). Dopaminergic projections from midbrain to primary motor cortex mediate motor skill learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Houk JC, Wise SP. (1995). Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cerebral cortex (New York, N.Y. : 1991). 5 [PubMed]

Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]

Jones SR et al. (2010). Cued spatial attention drives functionally relevant modulation of the mu rhythm in primary somatosensory cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]

Kelemen E, Fenton AA. (2010). Dynamic grouping of hippocampal neural activity during cognitive control of two spatial frames. PLoS biology. 8 [PubMed]

Kerr CC et al. (2012). Electrostimulation as a prosthesis for repair of information flow in a computer model of neocortex. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society. 20 [PubMed]

Kerr CC et al. (2013). Cortical information flow in Parkinson's disease: a composite network/field model. Frontiers in computational neuroscience. 7 [PubMed]

Kubikova L, Kostál L. (2010). Dopaminergic system in birdsong learning and maintenance. Journal of chemical neuroanatomy. 39 [PubMed]

Le Novère N. (2007). The long journey to a Systems Biology of neuronal function. BMC systems biology. 1 [PubMed]

Luft AR, Schwarz S. (2009). Dopaminergic signals in primary motor cortex. International journal of developmental neuroscience : the official journal of the International Society for Developmental Neuroscience. 27 [PubMed]

Lungarella M, Sporns O. (2006). Mapping information flow in sensorimotor networks. PLoS computational biology. 2 [PubMed]

Lytton W, Neymotin S, Kerr C, Francis J. (2011). Training oscillatory dynamics with spike-timing-dependent plasticity in a computer model of neocortex Signal Processing in Medicine and Biology Symposium (SPMB), IEEE.

Lytton WW. (2008). Computer modelling of epilepsy. Nature reviews. Neuroscience. 9 [PubMed]

Lytton WW, Neymotin SA, Hines ML. (2008). The virtual slice setup. Journal of neuroscience methods. 171 [PubMed]

Lytton WW, Omurtag A. (2007). Tonic-clonic transitions in computer simulation. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 24 [PubMed]

Lytton WW, Omurtag A, Neymotin SA, Hines ML. (2008). Just-in-time connectivity for large spiking networks. Neural computation. 20 [PubMed]

Lytton WW, Stewart M. (2005). A rule-based firing model for neural networks Int J Bioelectromagn. 7

Lytton WW, Stewart M. (2006). Rule-based firing for network simulations. Neurocomputing. 69

Mahmoudi B, Sanchez JC. (2011). A symbiotic brain-machine interface through value-based decision making. PloS one. 6 [PubMed]

Mo J, Schroeder CE, Ding M. (2011). Attentional modulation of alpha oscillations in macaque inferotemporal cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Molina-Luna K et al. (2009). Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PloS one. 4 [PubMed]

Neymotin SA, Jacobs KM, Fenton AA, Lytton WW. (2011). Synaptic information transfer in computer models of neocortical columns. Journal of computational neuroscience. 30 [PubMed]

Neymotin SA et al. (2011). Ketamine disrupts ? modulation of ? in a computer model of hippocampus. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Neymotin SA, Lee H, Park E, Fenton AA, Lytton WW. (2011). Emergence of physiological oscillation frequencies in a computer model of neocortex. Frontiers in computational neuroscience. 5 [PubMed]

Pastalkova E et al. (2006). Storage of spatial information by the maintenance mechanism of LTP. Science (New York, N.Y.). 313 [PubMed]

Peterson BE, Healy MD, Nadkarni PM, Miller PL, Shepherd GM. (1996). ModelDB: an environment for running and storing computational models and their results applied to neuroscience. Journal of the American Medical Informatics Association : JAMIA. 3 [PubMed]

Potjans W, Morrison A, Diesmann M. (2009). A spiking neural network model of an actor-critic learning agent. Neural computation. 21 [PubMed]

Qiu S, Anderson CT, Levitt P, Shepherd GM. (2011). Circuit-specific intracortical hyperconnectivity in mice with deletion of the autism-associated Met receptor tyrosine kinase. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Reid RC. (2012). From functional architecture to functional connectomics. Neuron. 75 [PubMed]

Reynolds JN, Wickens JR. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]

Roberts PD, Bell CC. (2002). Spike timing dependent synaptic plasticity in biological systems. Biological cybernetics. 87 [PubMed]

Rowan MS, Neymotin SA. (2013). Synaptic Scaling Balances Learning in a Spiking Model of Neocortex Adaptive and Natural Computing Algorithms. 7824

Sanes JN. (2003). Neocortical mechanisms in motor learning. Current opinion in neurobiology. 13 [PubMed]

Seung HS. (2003). Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron. 40 [PubMed]

Shadmehr R, Krakauer JW. (2008). A computational neuroanatomy for motor control. Experimental brain research. 185 [PubMed]

Shadmehr R, Wise S. (2005). The computational neurobiology of reaching and pointing: a foundation for motor learning.

Shen W, Flajolet M, Greengard P, Surmeier DJ. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, N.Y.). 321 [PubMed]

Shepherd G. (2004). The synaptic organization of the brain.

Singer W, Konig P, Gray C, Kreiter A, Engel A. (1991). Temporal coding by coherent oscillations as a potential solution to the binding problem: physiological evidence Nonlinear dynamics and neural networks.

Sober SJ, Brainard MS. (2009). Adult birdsong is actively maintained by error correction. Nature neuroscience. 12 [PubMed]

Song S, Miller KD, Abbott LF. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature neuroscience. 3 [PubMed]

Sporns O, Tononi G, Kötter R. (2005). The human connectome: A structural description of the human brain. PLoS computational biology. 1 [PubMed]

Tarigoppula A, Marsh B, Francis J. (2011). Correlates of reward expectation in the primary motor cortex: Developing an actor-critic model in macaques for a brain computer interface Society for Neuroscience Abstracts, 41.

Thomson AM, Lamy C. (2007). Functional maps of neocortical local circuitry. Frontiers in neuroscience. 1 [PubMed]

Thomson AM, West DC, Wang Y, Bannister AP. (2002). Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: triple intracellular recordings and biocytin labelling in vitro. Cerebral cortex (New York, N.Y. : 1991). 12 [PubMed]

Thorndike E. (1911). Animal intelligence.

Tiesinga PH, Sejnowski TJ. (2004). Rapid temporal modulation of synchrony by competition in cortical interneuron networks. Neural computation. 16 [PubMed]

Uhlhaas PJ, Singer W. (2006). Neural synchrony in brain disorders: relevance for cognitive dysfunctions and pathophysiology. Neuron. 52 [PubMed]

Von_hofsten C. (1979). Development of visually directed reaching: The approach phase Department Of Psychology, University Of Uppsala [psykologiska Inst , Uppsala Univ ].

Webb B. (2000). What does robotics offer animal behaviour? Animal behaviour. 60 [PubMed]

von Kraus LM, Sacktor TC, Francis JT. (2010). Erasing sensorimotor memories via PKMzeta inhibition. PloS one. 5 [PubMed]

von der Malsburg C, Schneider W. (1986). A neural cocktail-party processor. Biological cybernetics. 54 [PubMed]

References and models that cite this paper

Dura-Bernal S et al. (2016). Restoring Behavior via Inverse Neurocontroller in a Lesioned Cortical Spiking Model Driving a Virtual Arm. Frontiers in neuroscience. 10 [PubMed]

Dura-Bernal S et al. (2015). Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm. Frontiers in neurorobotics. 9 [PubMed]

Eguchi A, Neymotin SA, Stringer SM. (2014). Color opponent receptive fields self-organize in a biophysical model of visual cortex via spike-timing dependent plasticity Frontiers in neural circuits. 8 [PubMed]

Lytton WW et al. (2017). Evolutionary algorithm optimization of biological learning parameters in a biomimetic neuroprosthesis. IBM Journal of Research and Development (Computational Neuroscience special issue). 61(2/3)

Mulcahy G, Atwood B, Kuznetsov A. (2020). Basal ganglia role in learning rewarded actions and executing previously learned choices: Healthy and diseased states. PloS one. 15 [PubMed]

Sudhakar SK et al. (2017). Spatiotemporal network coding of physiological mossy fiber inputs by the cerebellar granular layer. PLoS computational biology. 13 [PubMed]

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.