Moustafa AA, Cohen MX, Sherman SJ, Frank MJ. (2008). A role for dopamine in temporal decision making and reward maximization in parkinsonism. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28 [PubMed]

See more from authors: Moustafa AA · Cohen MX · Sherman SJ · Frank MJ

References and models cited by this paper

Alexander GE, DeLong MR, Strick PL. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual review of neuroscience. 9 [PubMed]

Aquilonius SM et al. (1996). Levodopa-induced changes in synaptic dopamine in patients with Parkinson's disease as measured by [11C]raclopride displacement and PET. Neurology. 46

Ashby FG, O'Brien JB. (2005). Category learning and multiple memory systems. Trends in cognitive sciences. 9 [PubMed]

Barto AG, Sutton RS. (1998). Reinforcement learning: an introduction.

Bayer HM, Lau B, Glimcher PW. (2007). Statistics of midbrain dopamine neuron spike trains in the awake primate. Journal of neurophysiology. 98 [PubMed]

Berridge KC. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology. 191 [PubMed]

Brück A et al. (2006). Striatal subregional 6-[18F]fluoro-L-dopa uptake in early Parkinson's disease: a two-year follow-up study. Movement disorders : official journal of the Movement Disorder Society. 21 [PubMed]

Chevalier G, Deniau JM. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends in neurosciences. 13 [PubMed]

Cools R. (2006). Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neuroscience and biobehavioral reviews. 30 [PubMed]

Cools R, Altamirano L, D'Esposito M. (2006). Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia. 44 [PubMed]

Cools R, Barker RA, Sahakian BJ, Robbins TW. (2001). Mechanisms of cognitive set flexibility in Parkinson's disease. Brain : a journal of neurology. 124 [PubMed]

Dalley JW et al. (2005). Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proceedings of the National Academy of Sciences of the United States of America. 102 [PubMed]

Daw ND, Niv Y, Dayan P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature neuroscience. 8 [PubMed]

Delgado MR, Miller MM, Inati S, Phelps EA. (2005). An fMRI study of reward-related probability learning. NeuroImage. 24 [PubMed]

Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of neurophysiology. 84 [PubMed]

Doya K. (2000). Complementary roles of basal ganglia and cerebellum in learning and motor control. Current opinion in neurobiology. 10 [PubMed]

Egelman DM, Person C, Montague PR. (1998). A computational role for dopamine delivery in human decision-making. Journal of cognitive neuroscience. 10 [PubMed]

Everitt BJ, Robbins TW. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature neuroscience. 8 [PubMed]

Frank MJ. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of cognitive neuroscience. 17 [PubMed]

Frank MJ. (2006). Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural networks : the official journal of the International Neural Network Society. 19 [PubMed]

Frank MJ, Claus ED. (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological review. 113 [PubMed]

Frank MJ, Loughry B, O'Reilly RC. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cognitive, affective & behavioral neuroscience. 1 [PubMed]

Frank MJ, Moustafa AA, Haughey HM, Curran T, Hutchison KE. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences of the United States of America. 104 [PubMed]

Frank MJ, O'Reilly RC. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behavioral neuroscience. 120 [PubMed]

Frank MJ, Samanta J, Moustafa AA, Sherman SJ. (2007). Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science (New York, N.Y.). 318 [PubMed]

Frank MJ, Santamaria A, O'Reilly RC, Willcutt E. (2007). Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 32 [PubMed]

Frank MJ, Scheres A, Sherman SJ. (2007). Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 362 [PubMed]

Frank MJ, Seeberger LC, O'reilly RC. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science (New York, N.Y.). 306 [PubMed]

Gonon F. (1997). Prolonged and extrasynaptic excitatory action of dopamine mediated by D1 receptors in the rat striatum in vivo. The Journal of neuroscience : the official journal of the Society for Neuroscience. 17 [PubMed]

Graybiel AM. (1998). The basal ganglia and chunking of action repertoires. Neurobiology of learning and memory. 70 [PubMed]

Graybiel AM. (2004). Network-level neuroplasticity in cortico-basal ganglia pathways. Parkinsonism & related disorders. 10 [PubMed]

Gurney K, Prescott TJ, Redgrave P. (2001). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological cybernetics. 84 [PubMed]

Hariri AR et al. (2006). Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]

Heerey EA, Robinson BM, McMahon RP, Gold JM. (2007). Delay discounting in schizophrenia. Cognitive neuropsychiatry. 12 [PubMed]

Holroyd CB, Larsen JT, Cohen JD. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology. 41 [PubMed]

Houk JC et al. (2007). Action selection and refinement in subcortical loops through basal ganglia and cerebellum. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 362 [PubMed]

Judd CM, McClelland GH. (1989). Data analysis, a model-comparison approach.

Kish SJ, Shannak K, Hornykiewicz O. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. The New England journal of medicine. 318 [PubMed]

Knowlton BJ, Mangels JA, Squire LR. (1996). A neostriatal habit learning system in humans. Science (New York, N.Y.). 273 [PubMed]

Lustig C, Matell MS, Meck WH. (2005). Not "just" a coincidence: frontal-striatal interactions in working memory and interval timing. Memory (Hove, England). 13 [PubMed]

Maddox WT, Filoteo JV. (2001). Striatal contributions to category learning: quantitative modeling of simple linear and complex nonlinear rule learning in patients with Parkinson's disease. Journal of the International Neuropsychological Society : JINS. 7 [PubMed]

Maida AS, Moustafa AA. (2007). Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia Cogn Syst Res. 8

Mazzoni P, Hristova A, Krakauer JW. (2007). Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

McClure SM, Daw ND, Montague PR. (2003). A computational substrate for incentive salience. Trends in neurosciences. 26 [PubMed]

McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD. (2007). Time discounting for primary rewards. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

McClure SM, Laibson DI, Loewenstein G, Cohen JD. (2004). Separate neural systems value immediate and delayed monetary rewards. Science (New York, N.Y.). 306 [PubMed]

Mink JW. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Progress in neurobiology. 50 [PubMed]

Montague PR, Berns GS. (2002). Neural economics and the biological substrates of valuation. Neuron. 36 [PubMed]

Montague PR, Dayan P, Sejnowski TJ. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]

Moustafa AA, Sherman SJ, Frank MJ. (2008). A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism. Neuropsychologia. 46 [PubMed]

Nakamura K, Hikosaka O. (2006). Role of dopamine in the primate caudate nucleus in reward modulation of saccades. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]

Niv Y, Daw ND, Joel D, Dayan P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology. 191 [PubMed]

Niv Y, Rivlin-Etzion M. (2007). Parkinson's disease: fighting the will? The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]

O'Reilly RC, Frank MJ, Hazy TE, Watz B. (2007). PVLV: the primary value and learned value Pavlovian learning algorithm. Behavioral neuroscience. 121 [PubMed]

Packard MG, McGaugh JL. (1996). Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiology of learning and memory. 65 [PubMed]

Pavese N et al. (2006). Clinical correlates of levodopa-induced dopamine release in Parkinson disease: a PET study. Neurology. 67 [PubMed]

Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 442 [PubMed]

Reynolds JN, Hyland BI, Wickens JR. (2001). A cellular mechanism of reward-related learning. Nature. 413 [PubMed]

Satoh T, Nakai S, Sato T, Kimura M. (2003). Correlated coding of motivation and outcome of decision by dopamine neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]

Scheres A et al. (2006). Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms. Neuropsychologia. 44 [PubMed]

Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]

Seeman P. (2008). Dopamine D2(High) receptors on intact cells. Synapse (New York, N.Y.). 62 [PubMed]

Sejnowski TJ, Berns GS. (1995). How the basal ganglia make decisions Neurobiology of decision-making.

Shen W, Flajolet M, Greengard P, Surmeier DJ. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, N.Y.). 321 [PubMed]

Shohamy D, Myers CE, Geghman KD, Sage J, Gluck MA. (2006). L-dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia. 44 [PubMed]

Shohamy D et al. (2004). Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain : a journal of neurology. 127 [PubMed]

Shohamy D, Myers CE, Kalanithi J, Gluck MA. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and biobehavioral reviews. 32 [PubMed]

Suri RE, Schultz W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental brain research. 121 [PubMed]

Surmeier DJ, Ding J, Day M, Wang Z, Shen W. (2007). D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends in neurosciences. 30 [PubMed]

Tobler PN, Fiorillo CD, Schultz W. (2005). Adaptive coding of reward value by dopamine neurons. Science (New York, N.Y.). 307 [PubMed]

Touretzky DS, Daw ND, Courville AC. (2004). Timing and partial observability in the dopamine system Advances in neural information processing systems. 16

Tversky A, Kahneman D. (1979). Prospect theory: ananalysis of decision under risk Econometrica. 47

Venton BJ et al. (2003). Real-time decoding of dopamine concentration changes in the caudate-putamen during tonic and phasic firing. Journal of neurochemistry. 87 [PubMed]

Wickens JR, Begg AJ, Arbuthnott GW. (1996). Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience. 70 [PubMed]

References and models that cite this paper

Ursino M, Baston C. (2018). Aberrant learning in Parkinson's disease: A neurocomputational study on bradykinesia. The European journal of neuroscience. 47 [PubMed]

Ursino M et al. (2020). Mathematical modeling and parameter estimation of levodopa motor response in patients with parkinson disease. PloS one. 15 [PubMed]

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.