Almássy N, Edelman GM, Sporns O. (1998). Behavioral constraints in the development of neuronal properties: a cortical model embedded in a real-world device. Cerebral cortex (New York, N.Y. : 1991). 8 [PubMed]
Baker SN, Kilner JM, Pinches EM, Lemon RN. (1999). The role of synchrony and oscillations in the motor output. Experimental brain research. 128 [PubMed]
Barto AG, Sutton RS. (1998). Reinforcement learning: an introduction.
Bush G et al. (2002). Dorsal anterior cingulate cortex: a role in reward-based decision making. Proceedings of the National Academy of Sciences of the United States of America. 99 [PubMed]
Chadderdon G. (2009). A neurocomputational model of the functional role of dopamine in stimulus-response task learning and performance Ph.D. thesis, Indiana University.
Choi J, Sanchez J, Tarigoppula A, Marsh B, Chhatbar P. (2011). Control of a center-out reaching task using a reinforcement learning brain-machine interface Neural Engineering (NER), 2011 5th International IEEE-EMBS Conference on. IEEE.
Cools R. (2006). Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neuroscience and biobehavioral reviews. 30 [PubMed]
Dan Y, Poo MM. (2004). Spike timing-dependent plasticity of neural circuits. Neuron. 44 [PubMed]
Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ. (2006). Cortical substrates for exploratory decisions in humans. Nature. 441 [PubMed]
Demiris Y, Dearden A. (2005). From motor babbling to hierarchical learning by imitation: a robot developmental pathway From Animals To Animats.
Der R, Martius G. (2006). (2006) From motor babbling to purposive actions: Emerging self-exploration in a dynamical systems approach to early robot development From Animals to Animats. 9
Edelman GM. (1987). Neural Darwinism: The Theory of Neural Group Selection.
Farries MA, Fairhall AL. (2007). Reinforcement learning with modulated spike timing dependent synaptic plasticity. Journal of neurophysiology. 98 [PubMed]
Faure A, Haberland U, Condé F, El Massioui N. (2005). Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Florian RV. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural computation. 19 [PubMed]
Frank MJ, O'Reilly RC. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behavioral neuroscience. 120 [PubMed]
Frank MJ, Seeberger LC, O'reilly RC. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science (New York, N.Y.). 306 [PubMed]
Hecht-nielsen R. (1989). Theory of the backpropagation neural network Neural Networks IJCNN., International Joint Conference on. IEEE.
Hines ML, Carnevale NT. (2006). The NEURON Book.
Hollerman JR, Schultz W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature neuroscience. 1 [PubMed]
Hosp JA, Pekanovic A, Rioult-Pedotti MS, Luft AR. (2011). Dopaminergic projections from midbrain to primary motor cortex mediate motor skill learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]
Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]
Joel D, Niv Y, Ruppin E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Kao MH, Doupe AJ, Brainard MS. (2005). Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song. Nature. 433 [PubMed]
Koechlin E, Hyafil A. (2007). Anterior prefrontal function and the limits of human decision-making. Science (New York, N.Y.). 318 [PubMed]
Kohonen T. (1990). The self-organizing map Proc IEEE. 78
Luft AR, Schwarz S. (2009). Dopaminergic signals in primary motor cortex. International journal of developmental neuroscience : the official journal of the International Society for Developmental Neuroscience. 27 [PubMed]
Lytton WW, Neymotin SA, Hines ML. (2008). The virtual slice setup. Journal of neuroscience methods. 171 [PubMed]
Lytton WW, Omurtag A. (2007). Tonic-clonic transitions in computer simulation. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 24 [PubMed]
Lytton WW, Omurtag A, Neymotin SA, Hines ML. (2008). Just-in-time connectivity for large spiking networks. Neural computation. 20 [PubMed]
Lytton WW, Stewart M. (2005). A rule-based firing model for neural networks Int J Bioelectromagn. 7
Lytton WW, Stewart M. (2006). Rule-based firing for network simulations. Neurocomputing. 69
Magee JC, Johnston D. (1995). Synaptic activation of voltage-gated channels in the dendrites of hippocampal pyramidal neurons. Science (New York, N.Y.). 268 [PubMed]
Molina-Luna K et al. (2009). Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PloS one. 4 [PubMed]
Mufson EJ, Pandya DN. (1984). Some observations on the course and composition of the cingulum bundle in the rhesus monkey. The Journal of comparative neurology. 225 [PubMed]
Neymotin SA, Lee H, Park E, Fenton AA, Lytton WW. (2011). Emergence of physiological oscillation frequencies in a computer model of neocortex. Frontiers in computational neuroscience. 5 [PubMed]
O'Neill M, Brown VJ. (2007). The effect of striatal dopamine depletion and the adenosine A2A antagonist KW-6002 on reversal learning in rats. Neurobiology of learning and memory. 88 [PubMed]
Parkinson JA et al. (2002). Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behavioural brain research. 137 [PubMed]
Potjans W, Morrison A, Diesmann M. (2009). A spiking neural network model of an actor-critic learning agent. Neural computation. 21 [PubMed]
Reynolds JN, Wickens JR. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Robbins TW, Giardini V, Jones GH, Reading P, Sahakian BJ. (1990). Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task. Behavioural brain research. 38 [PubMed]
Roberts PD, Bell CC. (2002). Spike timing dependent synaptic plasticity in biological systems. Biological cybernetics. 87 [PubMed]
Rumelhart D, Mccleland J. (1986). Parallel Distributed Processing.
Schultz W. (1998). Predictive reward signal of dopamine neurons. Journal of neurophysiology. 80 [PubMed]
Seung HS. (2003). Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron. 40 [PubMed]
Shen W, Flajolet M, Greengard P, Surmeier DJ. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, N.Y.). 321 [PubMed]
Shima K, Tanji J. (1998). Role for cingulate motor area cells in voluntary movement selection based on reward. Science (New York, N.Y.). 282 [PubMed]
Singer W. (2003). Synchronization, binding and expectancy The handbook of brain theory and neural networks.
Smith-Roe SL, Kelley AE. (2000). Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Sober SJ, Brainard MS. (2009). Adult birdsong is actively maintained by error correction. Nature neuroscience. 12 [PubMed]
Song S, Miller KD, Abbott LF. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature neuroscience. 3 [PubMed]
Sporns O, Alexander WH. (2002). Neuromodulation and plasticity in an autonomous robot. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Takechi H, Eilers J, Konnerth A. (1998). A new class of synaptic response involving calcium release in dendritic spines. Nature. 396 [PubMed]
Tesauro G. (1995). Temporal difference learning and TD-Gammon Comm ACM. 38
Thorndike E. (1911). Animal intelligence.
Thorpe S, Fize D, Marlot C. (1996). Speed of processing in the human visual system. Nature. 381 [PubMed]
Tumer EC, Brainard MS. (2007). Performance variability enables adaptive plasticity of 'crystallized' adult birdsong. Nature. 450 [PubMed]
Ungless MA, Magill PJ, Bolam JP. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science (New York, N.Y.). 303 [PubMed]
VanRullen R, Guyonneau R, Thorpe SJ. (2005). Spike times make sense. Trends in neurosciences. 28 [PubMed]
Wanjerkhede SM, Bapi RS. (2008). Modeling the sub-cellular signaling pathways involved in reinforcement learning at the striatum. Progress in brain research. 168 [PubMed]
Chadderdon GL et al. (2014). Motor cortex microcircuit simulation based on brain activity mapping. Neural computation. 26 [PubMed]
Dura-Bernal S et al. (2015). Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm. Frontiers in neurorobotics. 9 [PubMed]
Kerr CC et al. (2013). Cortical information flow in Parkinson's disease: a composite network/field model. Frontiers in computational neuroscience. 7 [PubMed]
Lytton WW et al. (2017). Evolutionary algorithm optimization of biological learning parameters in a biomimetic neuroprosthesis. IBM Journal of Research and Development (Computational Neuroscience special issue). 61(2/3)
Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW. (2013). Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural computation. 25 [PubMed]