Abbott LF, Nelson SB. (2000). Synaptic plasticity: taming the beast. Nature neuroscience. 3 Suppl [PubMed]
Alexander GE, Crutcher MD. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends in neurosciences. 13 [PubMed]
Alexander GE, DeLong MR. (1985). Microstimulation of the primate neostriatum. II. Somatotopic organization of striatal microexcitable zones and their relation to neuronal response properties. Journal of neurophysiology. 53 [PubMed]
Alexander GE, DeLong MR, Strick PL. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual review of neuroscience. 9 [PubMed]
Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. (2005). Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature. 437 [PubMed]
Bauswein E, Fromm C, Preuss A. (1989). Corticostriatal cells in comparison with pyramidal tract neurons: contrasting properties in the behaving monkey. Brain research. 493 [PubMed]
Bayer HM, Glimcher PW. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron. 47 [PubMed]
Bayer HM, Lau B, Glimcher PW. (2007). Statistics of midbrain dopamine neuron spike trains in the awake primate. Journal of neurophysiology. 98 [PubMed]
Berke JD, Hyman SE. (2000). Addiction, dopamine, and the molecular mechanisms of memory. Neuron. 25 [PubMed]
Bienenstock EL, Cooper LN, Munro PW. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2 [PubMed]
Bolado-Gomez R, Gurney K. (2013). A biologically plausible embodied model of action discovery. Frontiers in neurorobotics. 7 [PubMed]
Bornstein AM, Daw ND. (2011). Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Current opinion in neurobiology. 21 [PubMed]
Bouton ME. (2004). Context and behavioral processes in extinction. Learning & memory (Cold Spring Harbor, N.Y.). 11 [PubMed]
Bouton ME, Todd TP, Vurbic D, Winterbauer NE. (2011). Renewal after the extinction of free operant behavior. Learning & behavior. 39 [PubMed]
Brown LL, Sharp FR. (1995). Metabolic mapping of rat striatum: somatotopic organization of sensorimotor activity. Brain research. 686 [PubMed]
Calabresi P, Picconi B, Tozzi A, Di Filippo M. (2007). Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in neurosciences. 30 [PubMed]
Centonze D, Picconi B, Gubellini P, Bernardi G, Calabresi P. (2001). Dopaminergic control of synaptic plasticity in the dorsal striatum. The European journal of neuroscience. 13 [PubMed]
Cragg SJ, Rice ME. (2004). DAncing past the DAT at a DA synapse. Trends in neurosciences. 27 [PubMed]
Crombag HS, Shaham Y. (2002). Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behavioral neuroscience. 116 [PubMed]
Cui G et al. (2013). Concurrent activation of striatal direct and indirect pathways during action initiation. Nature. 494 [PubMed]
Daw ND, Niv Y, Dayan P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature neuroscience. 8 [PubMed]
De Leonibus E et al. (2011). Cognitive and neural determinants of response strategy in the dual-solution plus-maze task. Learning & memory (Cold Spring Harbor, N.Y.). 18 [PubMed]
Dickinson A. (1985). Actions and habits: The development of behavioural autonomy Phil Trans Royal Soc London B. 308
Elsner B, Hommel B. (2004). Contiguity and contingency in action-effect learning. Psychological research. 68 [PubMed]
Evans RC, Maniar YM, Blackwell KT. (2013). Dynamic modulation of spike timing-dependent calcium influx during corticostriatal upstates. Journal of neurophysiology. 110 [PubMed]
Fan D, Rossi MA, Yin HH. (2012). Mechanisms of action selection and timing in substantia nigra neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 32 [PubMed]
Faure A, Haberland U, Condé F, El Massioui N. (2005). Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Fee MS. (2012). Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions. Frontiers in neural circuits. 6 [PubMed]
Fino E, Glowinski J, Venance L. (2005). Bidirectional activity-dependent plasticity at corticostriatal synapses. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Frank MJ. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of cognitive neuroscience. 17 [PubMed]
Freeze BS, Kravitz AV, Hammack N, Berke JD, Kreitzer AC. (2013). Control of basal ganglia output by direct and indirect pathway projection neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 33 [PubMed]
Gremel CM, Costa RM. (2013). Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nature communications. 4 [PubMed]
Gurney K, Prescott TJ, Redgrave P. (2001). A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour. Biological cybernetics. 84 [PubMed]
Gurney K, Prescott TJ, Redgrave P. (2001). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological cybernetics. 84 [PubMed]
Haber SN, Fudge JL, McFarland NR. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Hart AS, Rutledge RB, Glimcher PW, Phillips PE. (2014). Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]
Hikosaka O, Takikawa Y, Kawagoe R. (2000). Role of the basal ganglia in the control of purposive saccadic eye movements. Physiological reviews. 80 [PubMed]
Houk JC, Adams JL, Barto AGA. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models Of Information Processing In The Basal Ganglia.
Humphries MD, Lepora N, Wood R, Gurney K. (2009). Capturing dopaminergic modulation and bimodal membrane behaviour of striatal medium spiny neurons in accurate, reduced models. Frontiers in computational neuroscience. 3 [PubMed]
Humphries MD, Prescott TJ. (2010). The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Progress in neurobiology. 90 [PubMed]
Humphries MD, Stewart RD, Gurney KN. (2006). A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]
Ilango A et al. (2014). Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]
Izhikevich EM. (2003). Simple model of spiking neurons. IEEE transactions on neural networks. 14 [PubMed]
Izhikevich EM. (2007). Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting.
Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]
Jahr CE, Stevens CF. (1990). Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics. The Journal of neuroscience : the official journal of the Society for Neuroscience. 10 [PubMed]
Joel D, Weiner I. (2000). The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience. 96 [PubMed]
Khamassi M, Humphries MD. (2012). Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. Frontiers in behavioral neuroscience. 6 [PubMed]
Kim B, Hawes SL, Gillani F, Wallace LJ, Blackwell KT. (2013). Signaling pathways involved in striatal synaptic plasticity are sensitive to temporal pattern and exhibit spatial specificity. PLoS computational biology. 9 [PubMed]
Kimchi EY, Laubach M. (2009). The dorsomedial striatum reflects response bias during learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 29 [PubMed]
Kimchi EY, Torregrossa MM, Taylor JR, Laubach M. (2009). Neuronal correlates of instrumental learning in the dorsal striatum. Journal of neurophysiology. 102 [PubMed]
Kravitz AV et al. (2010). Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature. 466 [PubMed]
Kravitz AV, Tye LD, Kreitzer AC. (2012). Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nature neuroscience. 15 [PubMed]
Kreitzer AC, Berke JD. (2011). Investigating striatal function through cell-type-specific manipulations. Neuroscience. 198 [PubMed]
Lak A, Stauffer WR, Schultz W. (2014). Dopamine prediction error responses integrate subjective value from different reward dimensions. Proceedings of the National Academy of Sciences of the United States of America. 111 [PubMed]
Laurent PA. (2008). The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural networks : the official journal of the International Neural Network Society. 21 [PubMed]
Lindskog M, Kim M, Wikström MA, Blackwell KT, Kotaleski JH. (2006). Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation. PLoS computational biology. 2 [PubMed]
Mahon S, Deniau JM, Charpier S, Delord B. (2000). Role of a striatal slowly inactivating potassium current in short-term facilitation of corticostriatal inputs: a computer simulation study. Learning & memory (Cold Spring Harbor, N.Y.). 7 [PubMed]
Matsumoto M, Hikosaka O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature. 459 [PubMed]
Maurin Y, Banrezes B, Menetrey A, Mailly P, Deniau JM. (1999). Three-dimensional distribution of nigrostriatal neurons in the rat: relation to the topography of striatonigral projections. Neuroscience. 91 [PubMed]
McGeorge AJ, Faull RL. (1989). The organization of the projection from the cerebral cortex to the striatum in the rat. Neuroscience. 29 [PubMed]
Middleton FA, Strick PL. (2000). Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain research. Brain research reviews. 31 [PubMed]
Mink JW, Thach WT. (1993). Basal ganglia intrinsic circuits and their role in behavior. Current opinion in neurobiology. 3 [PubMed]
Mogenson GJ, Jones DL, Yim CY. (1980). From motivation to action: functional interface between the limbic system and the motor system. Progress in neurobiology. 14 [PubMed]
Montague PR, Dayan P, Sejnowski TJ. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]
Moyer JT, Wolf JA, Finkel LH. (2007). Effects of dopaminergic modulation on the integrative properties of the ventral striatal medium spiny neuron. Journal of neurophysiology. 98 [PubMed]
Nakano T, Doi T, Yoshimoto J, Doya K. (2010). A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. PLoS computational biology. 6 [PubMed]
Ostlund SB, Balline BW. (2007). Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learning & behavior. 35 [PubMed]
Paille V et al. (2013). GABAergic circuits control spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 33 [PubMed]
Pan WX, Brown J, Dudman JT. (2013). Neural signals of extinction in the inhibitory microcircuit of the ventral midbrain. Nature neuroscience. 16 [PubMed]
Pawlak V, Kerr JN. (2008). Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28 [PubMed]
Pfister JP, Gerstner W. (2006). Triplets of spikes in a model of spike timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]
Ponzi A, Wickens JR. (2013). Optimal balance of the striatal medium spiny neuron network. PLoS computational biology. 9 [PubMed]
Redgrave P. (2013). Action discovery and intrinsic motivation: a biologically constrained formalisation Intrinsically motivated learning in natural and artificial systems.
Redgrave P, Gurney K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nature reviews. Neuroscience. 7 [PubMed]
Redgrave P, Gurney K, Koene A, Lepora N, Shah A. (2013). Action discovery and intrinsic motivation: a biologically constrained formalisation Intrinsically motivated learning in natural and artificial systems..
Redgrave P, Gurney K, Reynolds J. (2008). What is reinforced by phasic dopamine signals? Brain research reviews. 58 [PubMed]
Redgrave P, Prescott TJ, Gurney K. (1999). The basal ganglia: a vertebrate solution to the selection problem? Neuroscience. 89 [PubMed]
Redish AD, Jensen S, Johnson A, Kurth-Nelson Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychological review. 114 [PubMed]
Reynolds JN, Hyland BI, Wickens JR. (2001). A cellular mechanism of reward-related learning. Nature. 413 [PubMed]
Reynolds JN, Wickens JR. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Romanelli P, Esposito V, Schaal DW, Heit G. (2005). Somatotopy in the basal ganglia: experimental and clinical evidence for segregated sensorimotor channels. Brain research. Brain research reviews. 48 [PubMed]
Samson RD, Frank MJ, Fellous JM. (2010). Computational models of reinforcement learning: the role of dopamine as a reward signal. Cognitive neurodynamics. 4 [PubMed]
Schilman EA, Uylings HB, Galis-de Graaf Y, Joel D, Groenewegen HJ. (2008). The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neuroscience letters. 432 [PubMed]
Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK. (2009). A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature reviews. Neuroscience. 10 [PubMed]
Schultz W. (2010). Dopamine signals for reward value and risk: basic and recent data. Behavioral and brain functions : BBF. 6 [PubMed]
Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]
Shan Q, Ge M, Christie MJ, Balleine BW. (2014). The acquisition of goal-directed actions generates opposing plasticity in direct and indirect pathways in dorsomedial striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]
Shen W, Flajolet M, Greengard P, Surmeier DJ. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, N.Y.). 321 [PubMed]
Shiflett MW, Balleine BW. (2011). Molecular substrates of action control in cortico-striatal circuits. Progress in neurobiology. 95 [PubMed]
Shiflett MW, Brown RA, Balleine BW. (2010). Acquisition and performance of goal-directed instrumental actions depends on ERK signaling in distinct regions of dorsal striatum in rats. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]
Shinomoto S, Shima K, Tanji J. (2003). Differences in spiking patterns among cortical neurons. Neural computation. 15 [PubMed]
Shouval HZ, Intrator N, Cooper L, Blais BB. (2004). Theory of cortical plasticity.
Smith R, Musleh W, Akopian G, Buckwalter G, Walsh JP. (2001). Regional differences in the expression of corticostriatal synaptic plasticity. Neuroscience. 106 [PubMed]
Sul JH, Kim H, Huh N, Lee D, Jung MW. (2010). Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron. 66 [PubMed]
Surmeier DJ, Ding J, Day M, Wang Z, Shen W. (2007). D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends in neurosciences. 30 [PubMed]
Tanaka S, NAKAJIMA S, Urushihara K, Imada H. (2000). Renewal of extinguished lever-press responses upon return to the training context Learn Motiv. 31
Tang C, Pawlak AP, Prokopenko V, West MO. (2007). Changes in activity of the striatum during formation of a motor habit. The European journal of neuroscience. 25 [PubMed]
Tecuapetla F, Matias S, Dugue GP, Mainen ZF, Costa RM. (2014). Balanced activity in basal ganglia projection pathways is critical for contraversive movements. Nature communications. 5 [PubMed]
Thorn CA, Atallah H, Howe M, Graybiel AM. (2010). Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron. 66 [PubMed]
Thorn CA, Graybiel AM. (2014). Differential entrainment and learning-related dynamics of spike and local field potential activity in the sensorimotor and associative striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]
Threlfell S et al. (2012). Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron. 75 [PubMed]
Todd TP, Winterbauer NE, Bouton ME. (2012). Contextual control of appetite. Renewal of inhibited food-seeking behavior in sated rats after extinction. Appetite. 58 [PubMed]
Tsai HC et al. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science (New York, N.Y.). 324 [PubMed]
Wang LP et al. (2011). NMDA receptors in dopaminergic neurons are crucial for habit learning. Neuron. 72 [PubMed]
Wang Z et al. (2006). Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron. 50 [PubMed]
Wickens JR, Budd CS, Hyland BI, Arbuthnott GW. (2007). Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix. Annals of the New York Academy of Sciences. 1104 [PubMed]
Wörgötter F, Porr B. (2005). Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural computation. 17 [PubMed]
Yin HH, Knowlton BJ. (2006). The role of the basal ganglia in habit formation. Nature reviews. Neuroscience. 7 [PubMed]
Yin HH, Knowlton BJ, Balleine BW. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European journal of neuroscience. 19 [PubMed]
Yin HH et al. (2009). Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nature neuroscience. 12 [PubMed]
Yin HH, Ostlund SB, Knowlton BJ, Balleine BW. (2005). The role of the dorsomedial striatum in instrumental conditioning. The European journal of neuroscience. 22 [PubMed]
Znamenskiy P, Zador AM. (2013). Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination. Nature. 497 [PubMed]
van Rossum MC, Bi GQ, Turrigiano GG. (2000). Stable Hebbian learning from spike timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Fountas Z, Shanahan M. (2017). The role of cortical oscillations in a spiking neural network model of the basal ganglia. PloS one. 12 [PubMed]
Hjorth JJJ et al. (2020). The microcircuits of striatum in silico. Proceedings of the National Academy of Sciences of the United States of America. 117 [PubMed]
Mulcahy G, Atwood B, Kuznetsov A. (2020). Basal ganglia role in learning rewarded actions and executing previously learned choices: Healthy and diseased states. PloS one. 15 [PubMed]