Motor system model with reinforcement learning drives virtual arm (Dura-Bernal et al 2017)


Lytton WW et al. (2017). Evolutionary algorithm optimization of biological learning parameters in a biomimetic neuroprosthesis. IBM Journal of Research and Development (Computational Neuroscience special issue). 61(2/3)

See more from authors: Lytton WW · Francis JT · Neymotin SA · Kerr CC · Dura-Bernal S · Sivagnanam S · Majumdar A

References and models cited by this paper

Anderson CT, Sheets PL, Kiritani T, Shepherd GM. (2010). Sublayer-specific microcircuits of corticospinal and corticostriatal neurons in motor cortex. Nature neuroscience. 13 [PubMed]

Bensmaia SJ, Miller LE. (2014). Restoring sensorimotor function through intracortical interfaces: progress and looming challenges. Nature reviews. Neuroscience. 15 [PubMed]

Beyer H. (2007). Evolution strategies Scholarpedia. 2(8)

Carlson KD, Nageswaran JM, Dutt N, Krichmar JL. (2014). An efficient automated parameter tuning framework for spiking neural networks. Frontiers in neuroscience. 8 [PubMed]

Carmena JM. (2013). Advances in neuroprosthetic learning and control. PLoS biology. 11 [PubMed]

Chadderdon GL et al. (2014). Motor cortex microcircuit simulation based on brain activity mapping. Neural computation. 26 [PubMed]

Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW. (2012). Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex. PloS one. 7 [PubMed]

DeWolf T, Eliasmith C. (2011). The neural optimal control hierarchy for motor control. Journal of neural engineering. 8 [PubMed]

Demandt E et al. (2012). Reaching movement onset- and end-related characteristics of EEG spectral power modulations. Frontiers in neuroscience. 6 [PubMed]

Dura-Bernal S et al. (2016). Restoring Behavior via Inverse Neurocontroller in a Lesioned Cortical Spiking Model Driving a Virtual Arm. Frontiers in neuroscience. 10 [PubMed]

Dura-Bernal S et al. (2015). Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm. Frontiers in neurorobotics. 9 [PubMed]

Fagg AH et al. (2007). Biomimetic brain machine interfaces for the control of movement. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

Flint RD, Lindberg EW, Jordan LR, Miller LE, Slutzky MW. (2012). Accurate decoding of reaching movements from field potentials in the absence of spikes. Journal of neural engineering. 9 [PubMed]

Frémaux N, Sprekeler H, Gerstner W. (2013). Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS computational biology. 9 [PubMed]

Hogri R et al. (2015). A neuro-inspired model-based closed-loop neuroprosthesis for the substitution of a cerebellar learning function in anesthetized rats. Scientific reports. 5 [PubMed]

Hosp JA, Pekanovic A, Rioult-Pedotti MS, Luft AR. (2011). Dopaminergic projections from midbrain to primary motor cortex mediate motor skill learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]

Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]

Izhikevich EM, Edelman GM. (2008). Large-scale model of mammalian thalamocortical systems. Proceedings of the National Academy of Sciences of the United States of America. 105 [PubMed]

Jorgenson LA et al. (2015). The BRAIN Initiative: developing technology to catalyse neuroscience discovery. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 370 [PubMed]

Kerr CC et al. (2012). Electrostimulation as a prosthesis for repair of information flow in a computer model of neocortex. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society. 20 [PubMed]

Kocaturk M, Gulcur HO, Canbeyli R. (2015). Toward Building Hybrid Biological/in silico Neural Networks for Motor Neuroprosthetic Control. Frontiers in neurorobotics. 9 [PubMed]

Kozloski J. (2016). Closed-Loop Brain Model of Neocortical Information-Based Exchange. Frontiers in neuroanatomy. 10 [PubMed]

Krichmar JL, Asher DE, Oros N. (2014). Evolution of biologically plausible neural networks performing a visually guided reaching task Proc. Genetic Evol. Comput. Conf..

Kubikova L, Kostál L. (2010). Dopaminergic system in birdsong learning and maintenance. Journal of chemical neuroanatomy. 39 [PubMed]

Lee D, Seo H, Jung MW. (2012). Neural basis of reinforcement learning and decision making. Annual review of neuroscience. 35 [PubMed]

Lee G et al. (2014). Towards real-time communication between in vivo neurophysiological data sources and simulator-based brain biomimetic models. Journal of computational surgery. 3 [PubMed]

Ling G. (2013). Newsmaker interview: Geoffrey Ling. DARPA aims to rebuild brains. Interview by Emily Underwood. Science (New York, N.Y.). 342 [PubMed]

Luque NR, Garrido JA, Carrillo RR, Coenen OJ, Ros E. (2011). Cerebellar input configuration toward object model abstraction in manipulation tasks. IEEE transactions on neural networks. 22 [PubMed]

Lytton W et al. (2015). Large-scale m1 microcircuit model with plastic input connections from biological pmd neurons used for prosthetic arm control 24th Annual Computational Neuroscience Meeting (CNS15) BMC Neuroscience.

Lytton WW et al. (2016). Simulation Neurotechnologies for Advancing Brain Research: Parallelizing Large Networks in NEURON. Neural computation. 28 [PubMed]

Markram H et al. (2015). Reconstruction and Simulation of Neocortical Microcircuitry. Cell. 163 [PubMed]

Marsh BT, Tarigoppula VS, Chen C, Francis JT. (2015). Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 35 [PubMed]

Martin WN, Lienig J, Cohoon JP. (1997). Island (migration) models: Evolutionary algorithms based on punctuated equilibria Handbook of Evolutionary Computation. 6(3)

Migliore M, Cannia C, Lytton WW, Markram H, Hines ML. (2006). Parallel network simulations with NEURON. Journal of computational neuroscience. 21 [PubMed]

Miranda RA et al. (2015). DARPA-funded efforts in the development of novel brain-computer interface technologies. Journal of neuroscience methods. 244 [PubMed]

Molina-Luna K et al. (2009). Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PloS one. 4 [PubMed]

Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW. (2013). Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural computation. 25 [PubMed]

Neymotin SA et al. (2016). Calcium regulation of HCN channels supports persistent activity in a multiscale model of neocortex. Neuroscience. 316 [PubMed]

Nowostawski M, Poli R. (1999). Parallel genetic algorithm taxonomy Proc. IEEE 3rd Int. Conf. Knowl.-Based Intell. Inf. Eng. Syst..

Orin D, Featherstone R. (2000). Robot dynamics: Equations and algorithms In ICRA (International Conference Robotics and Automation).

Prins NW, Sanchez JC, Prasad A. (2014). A confidence metric for using neurobiological feedback in actor-critic reinforcement learning based brain-machine interfaces. Frontiers in neuroscience. 8 [PubMed]

Rumbell TH et al. (2016). Automated evolutionary optimization of ion channel conductances and kinetics in models of young and aged rhesus monkey pyramidal neurons. Journal of computational neuroscience. 41 [PubMed]

Sanchez J et al. (2012). Dynamically repairing and replacing neural networks: using hybrid computational and biological tools. IEEE pulse. 3 [PubMed]

Shadmehr R, Krakauer JW. (2008). A computational neuroanatomy for motor control. Experimental brain research. 185 [PubMed]

Shadmehr R, Mussa-Ivaldi FA. (1994). Adaptive representation of dynamics during learning of a motor task. The Journal of neuroscience : the official journal of the Society for Neuroscience. 14 [PubMed]

Skolicki Z, De Jong K. (2005). The influence of migration sizes and intervals on island models Proc. 7th Annu. Conf. Genetic Evol. Comput..

Song W, Kerr CC, Lytton WW, Francis JT. (2013). Cortical plasticity induced by spike-triggered microstimulation in primate somatosensory cortex. PloS one. 8 [PubMed]

Stanley GB. (2013). Reading and writing the neural code. Nature neuroscience. 16 [PubMed]

Tessadori J, Bisio M, Martinoia S, Chiappalone M. (2012). Modular neuronal assemblies embodied in a closed-loop environment: toward future integration of brains and machines. Frontiers in neural circuits. 6 [PubMed]

Thelen DG, Anderson FC, Delp SL. (2003). Generating dynamic simulations of movement using computed muscle control. Journal of biomechanics. 36 [PubMed]

Van Geit W, De Schutter E, Achard P. (2008). Automated neuron model optimization techniques: a review. Biological cybernetics. 99 [PubMed]

Weiler N, Wood L, Yu J, Solla SA, Shepherd GM. (2008). Top-down laminar organization of the excitatory network in motor cortex. Nature neuroscience. 11 [PubMed]

Yagishita S et al. (2014). A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science (New York, N.Y.). 345 [PubMed]

References and models that cite this paper

Neymotin SA et al. (2017). Optimizing computer models of corticospinal neurons to replicate in vitro dynamics. Journal of neurophysiology. 117 [PubMed]

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.