Adams RA, Huys QJ, Roiser JP. (2016). Computational Psychiatry: towards a mathematically informed understanding of mental illness. Journal of neurology, neurosurgery, and psychiatry. 87 [PubMed]
Afraimovich V, Tristan I, Huerta R, Rabinovich MI. (2008). Winnerless competition principle and prediction of the transient dynamics in a Lotka-Volterra model. Chaos (Woodbury, N.Y.). 18 [PubMed]
Baldassarre G et al. (2013). Intrinsically motivated action-outcome learning and goal-based action recall: a system-level bio-constrained computational model. Neural networks : the official journal of the International Neural Network Society. 41 [PubMed]
Balleine BW. (2005). Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiology & behavior. 86 [PubMed]
Balleine BW, O'Doherty JP. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 35 [PubMed]
Belcher AM, Volkow ND, Moeller FG, Ferré S. (2014). Personality traits and vulnerability or resilience to substance use disorders. Trends in cognitive sciences. 18 [PubMed]
Belin D, Belin-Rauscent A, Everitt BJ, Dalley JW. (2016). In search of predictive endophenotypes in addiction: insights from preclinical research. Genes, brain, and behavior. 15 [PubMed]
Belin D, Berson N, Balado E, Piazza PV, Deroche-Gamonet V. (2011). High-novelty-preference rats are predisposed to compulsive cocaine self-administration. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 36 [PubMed]
Belin D, Deroche-Gamonet V. (2012). Responses to novelty and vulnerability to cocaine addiction: contribution of a multi-symptomatic animal model. Cold Spring Harbor perspectives in medicine. 2 [PubMed]
Belin D, Everitt BJ. (2008). Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron. 57 [PubMed]
Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ. (2008). High impulsivity predicts the switch to compulsive cocaine-taking. Science (New York, N.Y.). 320 [PubMed]
Bellman R. (1966). Dynamic programming. Science (New York, N.Y.). 153 [PubMed]
Carroll ME, Morgan AD, Lynch WJ, Campbell UC, Dess NK. (2002). Intravenous cocaine and heroin self-administration in rats selectively bred for differential saccharin intake: phenotype and sex differences. Psychopharmacology. 161 [PubMed]
Cohen MX, Frank MJ. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behavioural brain research. 199 [PubMed]
Covington HE, Miczek KA. (2005). Intense cocaine self-administration after episodic social defeat stress, but not after aggressive behavior: dissociation from corticosterone activation. Psychopharmacology. 183 [PubMed]
Dalley JW, Everitt BJ, Robbins TW. (2011). Impulsivity, compulsivity, and top-down cognitive control. Neuron. 69 [PubMed]
Dalley JW et al. (2007). Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science (New York, N.Y.). 315 [PubMed]
Daw ND, Dayan P. (2014). The algorithmic anatomy of model-based evaluation. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 369 [PubMed]
Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron. 69 [PubMed]
Daw ND, Niv Y, Dayan P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature neuroscience. 8 [PubMed]
Daw ND, Simon DA. (2012). Dual-system learning models and drugs of abuse Computational Neuroscience of Drug Addiction.
Dayan P. (2009). Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry. 42 Suppl 1 [PubMed]
Dayan P, Watkins C. (1992). Q-learning Mach Learn. 8
Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston K. (2008). The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS computational biology. 4 [PubMed]
Dilleen R et al. (2012). High anxiety is a predisposing endophenotype for loss of control over cocaine, but not heroin, self-administration in rats. Psychopharmacology. 222 [PubMed]
Dolan RJ, Dayan P. (2013). Goals and habits in the brain. Neuron. 80 [PubMed]
Doll BB, Daw ND. (2016). The expanding role of dopamine. eLife. 5 [PubMed]
Doll BB, Jacobs WJ, Sanfey AG, Frank MJ. (2009). Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain research. 1299 [PubMed]
Draganski B et al. (2008). Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28 [PubMed]
Economidou D, Pelloux Y, Robbins TW, Dalley JW, Everitt BJ. (2009). High impulsivity predicts relapse to cocaine-seeking after punishment-induced abstinence. Biological psychiatry. 65 [PubMed]
Ersche KD, Turton AJ, Pradhan S, Bullmore ET, Robbins TW. (2010). Drug addiction endophenotypes: impulsive versus sensation-seeking personality traits. Biological psychiatry. 68 [PubMed]
Everitt BJ, Robbins TW. (2013). From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neuroscience and biobehavioral reviews. 37 [PubMed]
Everitt BJ, Robbins TW. (2016). Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On. Annual review of psychology. 67 [PubMed]
Fiore VG, Dolan RJ, Strausfeld NJ, Hirth F. (2015). Evolutionarily conserved mechanisms for the selection and maintenance of behavioural activity. Philosophical transactions of the Royal Society of London. Series B, Biological sciences. 370 [PubMed]
Fiore VG et al. (2018). Value encoding in the globus pallidus: fMRI reveals an interaction effect between reward and dopamine drive. NeuroImage. 173 [PubMed]
Fiore VG et al. (2016). Changing pattern in the basal ganglia: motor switching under reduced dopaminergic drive. Scientific reports. 6 [PubMed]
Flagel SB et al. (2010). An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 35 [PubMed]
Flagel SB, Waselus M, Clinton SM, Watson SJ, Akil H. (2014). Antecedents and consequences of drug abuse in rats selectively bred for high and low response to novelty. Neuropharmacology. 76 Pt B [PubMed]
Friston KJ, Harrison L, Penny W. (2003). Dynamic causal modelling. NeuroImage. 19 [PubMed]
Gannon BM, Galindo KI, Rice KC, Collins GT. (2017). Individual Differences in the Relative Reinforcing Effects of 3,4-Methylenedioxypyrovalerone under Fixed and Progressive Ratio Schedules of Reinforcement in Rats. The Journal of pharmacology and experimental therapeutics. 361 [PubMed]
Garrison KA, Potenza MN. (2014). Neuroimaging and biomarkers in addiction treatment. Current psychiatry reports. 16 [PubMed]
Gerfen CR, Surmeier DJ. (2011). Modulation of striatal projection systems by dopamine. Annual review of neuroscience. 34 [PubMed]
Gershman SJ, Horvitz EJ, Tenenbaum JB. (2015). Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science (New York, N.Y.). 349 [PubMed]
Gillan CM, Kosinski M, Whelan R, Phelps EA, Daw ND. (2016). Characterizing a psychiatric symptom dimension related to deficits in goal-directed control. eLife. 5 [PubMed]
Gould RW, Duke AN, Nader MA. (2014). PET studies in nonhuman primate models of cocaine abuse: translational research related to vulnerability and neuroadaptations. Neuropharmacology. 84 [PubMed]
Grahn JA, Parkinson JA, Owen AM. (2009). The role of the basal ganglia in learning and memory: neuropsychological studies. Behavioural brain research. 199 [PubMed]
Gruber AJ, McDonald RJ. (2012). Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior. Frontiers in behavioral neuroscience. 6 [PubMed]
Gutkin BS, Dehaene S, Changeux JP. (2006). A neurocomputational hypothesis for nicotine addiction. Proceedings of the National Academy of Sciences of the United States of America. 103 [PubMed]
Haber S. (2008). Parallel and integrative processing through the Basal Ganglia reward circuit: lessons from addiction. Biological psychiatry. 64 [PubMed]
Haber SN. (2003). The primate basal ganglia: parallel and integrative networks. Journal of chemical neuroanatomy. 26 [PubMed]
Hauser TU, Fiore VG, Moutoussis M, Dolan RJ. (2016). Computational Psychiatry of ADHD: Neural Gain Impairments across Marrian Levels of Analysis. Trends in neurosciences. 39 [PubMed]
Hoffman RE, McGlashan TH. (2001). Neural network models of schizophrenia. The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry. 7 [PubMed]
Huys QJ, Maia TV, Frank MJ. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nature neuroscience. 19 [PubMed]
Hyman SE, Malenka RC, Nestler EJ. (2006). Neural mechanisms of addiction: the role of reward-related learning and memory. Annual review of neuroscience. 29 [PubMed]
Jahanshahi M, Obeso I, Rothwell JC, Obeso JA. (2015). A fronto-striato-subthalamic-pallidal network for goal-directed and habitual inhibition. Nature reviews. Neuroscience. 16 [PubMed]
Jimenez VA, Grant KA. (2017). Studies using macaque monkeys to address excessive alcohol drinking and stress interactions. Neuropharmacology. 122 [PubMed]
Jonkman S, Pelloux Y, Everitt BJ. (2012). Drug intake is sufficient, but conditioning is not necessary for the emergence of compulsive cocaine seeking after extended self-administration. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 37 [PubMed]
Jupp B, Dalley JW. (2014). Behavioral endophenotypes of drug addiction: Etiological insights from neuroimaging studies. Neuropharmacology. 76 Pt B [PubMed]
Keramati M, Dezfouli A, Piray P. (2011). Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS computational biology. 7 [PubMed]
Koob GF, Volkow ND. (2016). Neurobiology of addiction: a neurocircuitry analysis. The lancet. Psychiatry. 3 [PubMed]
Laurent PA. (2008). The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural networks : the official journal of the International Neural Network Society. 21 [PubMed]
Littman ML, Jaakkola T, Singh S, Szepesvári C. (2000). Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms Machine Learning. 38
Maia TV, Frank MJ. (2011). From reinforcement learning models to psychiatric and neurological disorders. Nature neuroscience. 14 [PubMed]
McClintick MN, Grant KA. (2016). Aggressive temperament predicts ethanol self-administration in late adolescent male and female rhesus macaques. Psychopharmacology. 233 [PubMed]
Mirolli M et al. (2014). Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot Front Psychol. 5
Molander AC et al. (2011). High impulsivity predicting vulnerability to cocaine addiction in rats: some relationship with novelty preference but not novelty reactivity, anxiety or stress. Psychopharmacology. 215 [PubMed]
Montague PR, Dolan RJ, Friston KJ, Dayan P. (2012). Computational psychiatry. Trends in cognitive sciences. 16 [PubMed]
Moore AW, Atkeson CG. (1993). Prioritized sweeping: Reinforcement learning with less data and less real time Mach Learn. 13
Morgan D et al. (2002). Social dominance in monkeys: dopamine D2 receptors and cocaine self-administration. Nature neuroscience. 5 [PubMed]
Nadal R, Armario A, Janak PH. (2002). Positive relationship between activity in a novel environment and operant ethanol self-administration in rats. Psychopharmacology. 162 [PubMed]
Nader MA, Czoty PW. (2005). PET imaging of dopamine D2 receptors in monkey models of cocaine abuse: genetic predisposition versus environmental modulation. The American journal of psychiatry. 162 [PubMed]
Nestler EJ, Aghajanian GK. (1997). Molecular and cellular basis of addiction. Science (New York, N.Y.). 278 [PubMed]
Obeso JA, Rodriguez-Oroz MC, Stamelou M, Bhatia KP, Burn DJ. (2014). The expanding universe of disorders of the basal ganglia. Lancet (London, England). 384 [PubMed]
Pelloux Y, Everitt BJ, Dickinson A. (2007). Compulsive drug seeking by rats under punishment: effects of drug taking history. Psychopharmacology. 194 [PubMed]
Pelloux Y, Murray JE, Everitt BJ. (2015). Differential vulnerability to the punishment of cocaine related behaviours: effects of locus of punishment, cocaine taking history and alternative reinforcer availability. Psychopharmacology. 232 [PubMed]
Perry JL, Carroll ME. (2008). The role of impulsive behavior in drug abuse. Psychopharmacology. 200 [PubMed]
Pezzulo G, Rigoli F, Chersi F. (2013). The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. Frontiers in psychology. 4 [PubMed]
Piazza PV, Deminière JM, Le Moal M, Simon H. (1989). Factors that predict individual vulnerability to amphetamine self-administration. Science (New York, N.Y.). 245 [PubMed]
Piray P, Keramati MM, Dezfouli A, Lucas C, Mokri A. (2010). Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: a computational approach. Neural computation. 22 [PubMed]
Poggio T, Marr D. (1976). From understanding computation to understanding neural circuitry AI Memo. 357
Redish AD. (2004). Addiction as a computational process gone awry. Science (New York, N.Y.). 306 [PubMed]
Redish AD, Jensen S, Johnson A. (2008). A unified framework for addiction: vulnerabilities in the decision process. The Behavioral and brain sciences. 31 [PubMed]
Sadacca BF, Jones JL, Schoenbaum G. (2016). Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework. eLife. 5 [PubMed]
Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]
Selverston AI et al. (2000). Reliable circuits from irregular neurons: a dynamical approach to understanding central pattern generators. Journal of physiology, Paris. 94 [PubMed]
Silver D et al. (2016). Mastering the game of Go with deep neural networks and tree search. Nature. 529 [PubMed]
Smethells JR et al. (2016). Cocaine self-administration and reinstatement in female rats selectively bred for high and low voluntary running. Drug and alcohol dependence. 167 [PubMed]
Suto N, Austin JD, Vezina P. (2001). Locomotor response to novelty predicts a rat's propensity to self-administer nicotine. Psychopharmacology. 158 [PubMed]
Sutton RS. (1990). Integrated architectures for learning, planning, and reacting based on approximating dynamic programming Proceedings of the Seventh International Conference on Machine Learning.
Verdejo-García A, Lawrence AJ, Clark L. (2008). Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neuroscience and biobehavioral reviews. 32 [PubMed]
Volkow ND, Fowler JS, Wang GJ, Swanson JM, Telang F. (2007). Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Archives of neurology. 64 [PubMed]
Volkow ND, Morales M. (2015). The Brain on Drugs: From Reward to Addiction. Cell. 162 [PubMed]
Voon V, Reiter A, Sebold M, Groman S. (2017). Model-Based Control in Dimensional Psychiatry. Biological psychiatry. 82 [PubMed]
Willuhn I, Burgeno LM, Everitt BJ, Phillips PE. (2012). Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proceedings of the National Academy of Sciences of the United States of America. 109 [PubMed]
Yin HH, Knowlton BJ, Balleine BW. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European journal of neuroscience. 19 [PubMed]
desJardins ME, Durfee EH, Ortiz CL, Wolverton MJ. (1999). A survey of research in distributed, continual planning AI Magazine. 20