Blackwell KT, Doya K. (2023). Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks. PLoS computational biology. 19 [PubMed]

See more from authors: Blackwell KT · Doya K

References and models cited by this paper

Arbuthnott GW, Wickens J. (2007). Space, time and dopamine. Trends in neurosciences. 30 [PubMed]

Aston-Jones G, Cohen JD. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annual review of neuroscience. 28 [PubMed]

Balleine BW, Delgado MR, Hikosaka O. (2007). The role of the dorsal striatum in reward and decision-making. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

Balleine BW, Liljeholm M, Ostlund SB. (2009). The integrative function of the basal ganglia in instrumental conditioning. Behavioural brain research. 199 [PubMed]

Chudasama Y, Robbins TW. (2003). Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]

Cohen JD, McClure SM, Yu AJ. (2007). Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 362 [PubMed]

Collins AG, Frank MJ. (2014). Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychological review. 121 [PubMed]

Crittenden JR et al. (2016). Striosome-dendron bouquets highlight a unique striatonigral circuit targeting dopamine-containing neurons. Proceedings of the National Academy of Sciences of the United States of America. 113 [PubMed]

Doya K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural networks : the official journal of the International Neural Network Society. 12 [PubMed]

Doya K. (2002). Metalearning and neuromodulation. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]

Dreyer JK, Herrik KF, Berg RW, Hounsgaard JD. (2010). Influence of phasic and tonic dopamine release on receptor activation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]

Fino E, Deniau JM, Venance L. (2008). Cell-specific spike-timing-dependent plasticity in GABAergic and cholinergic interneurons in corticostriatal rat brain slices. The Journal of physiology. 586 [PubMed]

Geddes CE, Li H, Jin X. (2018). Optogenetic Editing Reveals the Hierarchical Organization of Learned Action Sequences. Cell. 174 [PubMed]

Gerfen CR, Surmeier DJ. (2011). Modulation of striatal projection systems by dopamine. Annual review of neuroscience. 34 [PubMed]

Gorodetski L et al. (2021). Endocannabinoids and Dopamine Balance Basal Ganglia Output. Frontiers in cellular neuroscience. 15 [PubMed]

Graybiel AM, Ragsdale CW. (1978). Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. Proceedings of the National Academy of Sciences of the United States of America. 75 [PubMed]

Gurney KN, Humphries MD, Redgrave P. (2015). A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS biology. 13 [PubMed]

Hamid AA et al. (2016). Mesolimbic dopamine signals the value of work. Nature neuroscience. 19 [PubMed]

Hawes SL et al. (2015). Multimodal Plasticity in Dorsal Striatum While Learning a Lateralized Navigation Task. The Journal of neuroscience : the official journal of the Society for Neuroscience. 35 [PubMed]

Hawes SL, Gillani F, Evans RC, Benkert EA, Blackwell KT. (2013). Sensitivity to theta-burst timing permits LTP in dorsal striatal adult brain slice. Journal of neurophysiology. 110 [PubMed]

Hollerman JR, Schultz W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature neuroscience. 1 [PubMed]

Humphries MD, Khamassi M, Gurney K. (2012). Dopaminergic Control of the Exploration-Exploitation Trade-Off via the Basal Ganglia. Frontiers in neuroscience. 6 [PubMed]

Johnson A, Redish AD. (2007). Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

Kerr JN, Wickens JR. (2001). Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. Journal of neurophysiology. 85 [PubMed]

Kincaid AE, Zheng T, Wilson CJ. (1998). Connectivity and convergence of single corticostriatal axons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]

Kita H. (2001). Neostriatal and globus pallidus stimulation induced inhibitory postsynaptic potentials in entopeduncular neurons in rat brain slice preparations. Neuroscience. 105 [PubMed]

Kravitz AV et al. (2010). Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature. 466 [PubMed]

Lavian H et al. (2017). Dopaminergic Modulation of Synaptic Integration and Firing Patterns in the Rat Entopeduncular Nucleus. The Journal of neuroscience : the official journal of the Society for Neuroscience. 37 [PubMed]

Lerner TN, Kreitzer AC. (2012). RGS4 is required for dopaminergic control of striatal LTD and susceptibility to parkinsonian motor deficits. Neuron. 73 [PubMed]

McDonald RJ, Ko CH, Hong NS. (2002). Attenuation of context-specific inhibition on reversal learning of a stimulus-response task in rats with neurotoxic hippocampal damage. Behavioural brain research. 136 [PubMed]

Morita K, Morishima M, Sakai K, Kawaguchi Y. (2012). Reinforcement learning: computing the temporal difference of values via distinct corticostriatal pathways. Trends in neurosciences. 35 [PubMed]

Nieto Mendoza E, Hernández Echeagaray E. (2015). Dopaminergic Modulation of Striatal Inhibitory Transmission and Long-Term Plasticity. Neural plasticity. 2015 [PubMed]

Nonomura S et al. (2018). Monitoring and Updating of Action Selection for Goal-Directed Behavior through the Striatal Direct and Indirect Pathways. Neuron. 99 [PubMed]

Paille V et al. (2013). GABAergic circuits control spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 33 [PubMed]

Pawlak V, Kerr JN. (2008). Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28 [PubMed]

Redish AD, Jensen S, Johnson A, Kurth-Nelson Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychological review. 114 [PubMed]

Russek EM, Momennejad I, Botvinick MM, Gershman SJ, Daw ND. (2017). Predictive representations can link model-based reinforcement learning to model-free mechanisms. PLoS computational biology. 13 [PubMed]

Samejima K, Ueda Y, Doya K, Kimura M. (2005). Representation of action-specific reward values in the striatum. Science (New York, N.Y.). 310 [PubMed]

Shan Q, Ge M, Christie MJ, Balleine BW. (2014). The acquisition of goal-directed actions generates opposing plasticity in direct and indirect pathways in dorsomedial striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]

Shen W, Flajolet M, Greengard P, Surmeier DJ. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, N.Y.). 321 [PubMed]

Smith KS, Graybiel AM. (2016). Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum. Journal of neurophysiology. 115 [PubMed]

Tecuapetla F, Jin X, Lima SQ, Costa RM. (2016). Complementary Contributions of Striatal Projection Pathways to Action Initiation and Execution. Cell. 166 [PubMed]

Usher M, Cohen JD, Servan-Schreiber D, Rajkowski J, Aston-Jones G. (1999). The role of locus coeruleus in the regulation of cognitive performance. Science (New York, N.Y.). 283 [PubMed]

Watabe-Uchida M, Zhu L, Ogawa SK, Vamanrao A, Uchida N. (2012). Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron. 74 [PubMed]

Yagishita S et al. (2014). A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science (New York, N.Y.). 345 [PubMed]

Yin HH, Knowlton BJ. (2006). The role of the basal ganglia in habit formation. Nature reviews. Neuroscience. 7 [PubMed]

Yin HH et al. (2009). Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nature neuroscience. 12 [PubMed]

Zheng T, Wilson CJ. (2002). Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. Journal of neurophysiology. 87 [PubMed]

Znamenskiy P, Zador AM. (2013). Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination. Nature. 497 [PubMed]

References and models that cite this paper
This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.