Smith AJ, Becker S, Kapur S. (2005). A computational model of the functional role of the ventral-striatal D2 receptor in the expression of previously acquired behaviors. Neural computation. 17 [PubMed]

See more from authors: Smith AJ · Becker S · Kapur S

References and models cited by this paper

ADER R, CLINK DW. (1957). Effects of chlorpromazine on the acquisition and extinction of an avoidance response in the rat. The Journal of pharmacology and experimental therapeutics. 121 [PubMed]

Aguilar MA, Marí-Sanmillán MI, Morant-Deusa JJ, Miñarro J. (2000). Different inhibition of conditioned avoidance response by clozapine and DA D1 and D2 antagonists in male mice. Behavioral neuroscience. 114 [PubMed]

Anisman H, Irwin J, Zacharko RM, Tombaugh TN. (1982). Effects of dopamine receptor blockade on avoidance performance: assessment of effects on cue-shock and response-outcome associations. Behavioral and neural biology. 36 [PubMed]

Arana FS et al. (2003). Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]

Arnt J. (1982). Pharmacological specificity of conditioned avoidance response inhibition in rats: inhibition by neuroleptics and correlation to dopamine receptor blockade. Acta pharmacologica et toxicologica. 51 [PubMed]

BLACK AH. (1963). The effects of CS-US interval on avoidance conditioning in the rat. Canadian journal of psychology. 17 [PubMed]

Barto AG, Sutton RS. (1981). An adaptive network that constructs and uses an internal model of its world Cognition And Brain Theory. 4

Barto AG, Sutton RS. (1998). Reinforcement learning: an introduction.

Bechara A, Damasio H, Tranel D, Anderson SW. (1998). Dissociation Of working memory from decision making within the human prefrontal cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]

Beck AT, Rector NA. (2003). A cognitive model of hallucinations Cognitive Therapy And Research. 27

Bell DS. (1973). The experimental reproduction of amphetamine psychosis. Archives of general psychiatry. 29 [PubMed]

Beninger RJ. (1989). Dissociating the effects of altered dopaminergic function on performance and learning. Brain research bulletin. 23 [PubMed]

Beninger RJ, Hahn BL. (1983). Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning. Science (New York, N.Y.). 220 [PubMed]

Beninger RJ, Mason ST, Phillips AG, Fibiger HC. (1980). The use of conditioned suppression to evaluate the nature of neuroleptic-induced avoidance deficits. The Journal of pharmacology and experimental therapeutics. 213 [PubMed]

Beninger RJ, Mason ST, Phillips AG, Fibiger HC. (1980). The use of extinction to investigate the nature of neuroleptic-induced avoidance deficits. Psychopharmacology. 69 [PubMed]

Berridge KC, Robinson TE. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain research. Brain research reviews. 28 [PubMed]

Berridge KC, Robinson TE. (2003). Parsing reward. Trends in neurosciences. 26 [PubMed]

Berridge KC, Schulkin J. (1989). Palatability shift of a salt-associated incentive during sodium depletion. The Quarterly journal of experimental psychology. B, Comparative and physiological psychology. 41 [PubMed]

Blackburn JR, Phillips AG. (1989). Blockade of acquisition of one-way conditioned avoidance responding by haloperidol and metoclopramide but not by thioridazine or clozapine: implications for screening new antipsychotic drugs. Psychopharmacology. 98 [PubMed]

CATANIA AC. (2005). Attention-Deficit/Hyperactivity Disorder (ADHD): delay-of-reinforcement gradients and other behavioral mechanisms Behavioral and Brain Sciences. 28

COOK L, CATANIA AC. (1964). EFFECTS OF DRUGS ON AVOIDANCE AND ESCAPE BEHAVIOR. Federation proceedings. 23 [PubMed]

COOK L, WEIDLEY E. (1957). Behavioral effects of some psychopharmacological agents. Annals of the New York Academy of Sciences. 66 [PubMed]

COURVOISIER S. (2005). Pharmacodynamic basis for the use of chlorpromazine in psychiatry. J Clin Exp Psychopathol. 17

Cador M, Robbins TW, Everitt BJ. (1989). Involvement of the amygdala in stimulus-reward associations: interaction with the ventral striatum. Neuroscience. 30 [PubMed]

Cardinal RN, Parkinson JA, Hall J, Everitt BJ. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience and biobehavioral reviews. 26 [PubMed]

Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science (New York, N.Y.). 292 [PubMed]

Cardinal RN, Robbins TW, Everitt BJ. (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology. 152 [PubMed]

Connell PH. (1958). Amphetamine psychosis.

Courvoisier S. (1956). Pharmacodynamic basis for the use of chlorpromazine in psychiatry Quart Rev Psych Neurol. 17

Cousins MS, Atherton A, Turner L, Salamone JD. (1996). Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behavioural brain research. 74 [PubMed]

DAVIS WM, CAPEHART J, LLEWELLIN WL. (1961). Mediated acquisition of a fear-motivated response and inhibitory effects of chlorpromazine. Psychopharmacologia. 2 [PubMed]

Davidson AB, Weidley E. (1976). Differential effects of neuroleptic and other psychotropic agents on acquisition of avoidance in rats. Life sciences. 18 [PubMed]

Dayan P. (2002). Motivated reinforcement learning Advances in neural information processing systems. 14

Dayan P, Balleine BW. (2002). Reward, motivation, and reinforcement learning. Neuron. 36 [PubMed]

Dews PB, Morse WH. (1961). Behavioral Pharmacology Ann Rev Pharmacol. 1

Di Chiara G. (1999). Drug addiction as dopamine-dependent associative learning disorder. European journal of pharmacology. 375 [PubMed]

Dias R, Robbins TW, Roberts AC. (1996). Dissociation in prefrontal cortex of affective and attentional shifts. Nature. 380 [PubMed]

Dickinson A. (1980). Contemporary animal learning theory.

Dickinson A. (1987). Instrumental performance following saccharin pre-feeding. Behavioural processes. 14 [PubMed]

Dickinson A, Balleine BW, Gonzalez F, Garner C. (1995). Motivational control of heterogeneous instrumental chains J Exp Psychol: Animal Behaviour Processes. 21

Dickinson A, Nicholas DJ, Adams CD. (1983). The effect of the instrumental training contingency on susceptibility to reinforcer devaluation Quart J Exp Psychol. 35B

Dickinson A, Smith J, Mirenowicz J. (2000). Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behavioral neuroscience. 114 [PubMed]

Ettenberg A. (1989). Dopamine, neuroleptics and reinforced behavior. Neuroscience and biobehavioral reviews. 13 [PubMed]

Ettenberg A, Koob GF, Bloom FE. (1981). Response artifact in the measurement of neuroleptic-induced anhedonia. Science (New York, N.Y.). 213 [PubMed]

Evenden JL, Robbins TW. (1983). Dissociable effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology. 79 [PubMed]

Everitt BJ, Cador M, Robbins TW. (1989). Interactions between the amygdala and ventral striatum in stimulus-reward associations: studies using a second-order schedule of sexual reinforcement. Neuroscience. 30 [PubMed]

Everitt BJ, Morris KA, O'Brien A, Robbins TW. (1991). The basolateral amygdala-ventral striatal system and conditioned place preference: further evidence of limbic-striatal interactions underlying reward-related processes. Neuroscience. 42 [PubMed]

Everitt BJ, Taylor JR, Robbins TW, Cador M. (2005). Limbic-striatal interactions in reward-related processes. Neurosci Biobehav Rev. 13

Fibiger HC, Carter DA, Phillips AG. (1976). Decreased intracranial self-stimulation after neuroleptics or 6-hydroxydopamine: evidence for mediation by motor deficits rather than by reduced reward. Psychopharmacology. 47 [PubMed]

Fiorillo CD, Tobler PN, Schultz W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science (New York, N.Y.). 299 [PubMed]

Fowler SC, LaCerra MM, Ettenberg A. (1986). Effects of haloperidol on the biophysical characteristics of operant responding: implications for motor and reinforcement processes. Pharmacology, biochemistry, and behavior. 25 [PubMed]

Frances A. (2000). Diagnostic and statistical manual of mental disorders.

Giordano LA et al. (2002). Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology. 163 [PubMed]

Gottfried JA, O'Doherty J, Dolan RJ. (2002). Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. The Journal of neuroscience : the official journal of the Society for Neuroscience. 22 [PubMed]

Grace AA. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience. 41 [PubMed]

Grace AA. (2000). Gating of information flow within the limbic system and the pathophysiology of schizophrenia. Brain research. Brain research reviews. 31 [PubMed]

Grilly DM, Johnson SK, Minardo R, Jacoby D, LaRiccia J. (1984). How do tranquilizing agents selectively inhibit conditioned avoidance responding? Psychopharmacology. 84 [PubMed]

HUNT HF. (1956). Some effects of drugs on classical (type S) conditioning. Annals of the New York Academy of Sciences. 65 [PubMed]

Hollerman JR, Schultz W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature neuroscience. 1 [PubMed]

Horvitz JC. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience. 96 [PubMed]

Horvitz JC. (2002). Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behavioural brain research. 137 [PubMed]

Houk JC, Adams JL, Barto AGA. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models Of Information Processing In The Basal Ganglia.

Ikemoto S, Panksepp J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain research. Brain research reviews. 31 [PubMed]

Irwin S. (1958). Factors influencing acquisition of avoidance behaviour and sensitivity to drugs Fed Proc. 17

Iversen SD, Mishkin M. (1970). Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Experimental brain research. 11 [PubMed]

JANSSEN PA, NIEMEGEERS CJ, SCHELLEKENS KH. (1965). IS IT POSSIBLE TO PREDICT THE CLINICAL EFFECTS OF NEUROLEPTIC DRUGS (MAJOR TRANQUILLIZERS) FROM ANIMAL DATA?I. "NEUROLEPTIC ACTIVITY SPECTRA" FOR RATS. Arzneimittel-Forschung. 15 [PubMed]

Jensen J et al. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron. 40 [PubMed]

Joseph MH, Datla K, Young AM. (2003). The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neuroscience and biobehavioral reviews. 27 [PubMed]

KAMIN LJ. (1954). Traumatic avoidance learning: the effects of CS-US interval with a trace-conditioning procedure. Journal of comparative and physiological psychology. 47 [PubMed]

KEY BJ. (1961). The effect of drugs on discrimination and sensory generalisation of auditory stimuli in cats. Psychopharmacologia. 2 [PubMed]

Kaelbling LP, Littman ML, Moore AW. (1996). Reinforcement learning: A survey J Art Intell Res. 4

Kandel E, Schwartz J, Jessell T. (1991). The Principles of Neural Science.

Kauer JA. (2003). Addictive drugs and stress trigger a common change at VTA synapses. Neuron. 37 [PubMed]

Kilts CD. (2001). The changing roles and targets for animal models of schizophrenia. Biological psychiatry. 50 [PubMed]

Low LA, Eliasson M, Kornetsky C. (1966). Effect of chlorpromazine on avoidance acquisition as a function of CS-US interval length. Psychopharmacologia. 10 [PubMed]

Low LA, Low HL. (1962). Effects of CS-US interval upon avoidance responding J Compar Physiol Psychol. 55

MAFFII G. (1959). The secondary conditioned response of rats and the effects of some psychopharmacological agents. The Journal of pharmacy and pharmacology. 11 [PubMed]

MILLER RE, MURPHY JV, MIRSKY IA. (1957). The effect of chlorpromazine on fear-motivated behavior in rats. The Journal of pharmacology and experimental therapeutics. 120 [PubMed]

Maher B, Ross JS. (1984). Delusions Comprehensive handbook of psychopathology.

Masterman DL, Cummings JL. (1997). Frontal-subcortical circuits: the anatomic basis of executive, social and motivated behaviors. Journal of psychopharmacology (Oxford, England). 11 [PubMed]

McClure SM, Daw ND, Montague PR. (2003). A computational substrate for incentive salience. Trends in neurosciences. 26 [PubMed]

Montague PR, Berns GS. (2002). Neural economics and the biological substrates of valuation. Neuron. 36 [PubMed]

Montague PR, Dayan P, Person C, Sejnowski TJ. (1995). Bee foraging in uncertain environments using predictive hebbian learning. Nature. 377 [PubMed]

Montague PR, Dayan P, Sejnowski TJ. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]

Moore H, West AR, Grace AA. (1999). The regulation of forebrain dopamine transmission: relevance to the pathophysiology and psychopathology of schizophrenia. Biological psychiatry. 46 [PubMed]

Moore JW, Schmajuk NA. (1988). The hippocampus and the classically conditioned nictitating membraneresponse: A real-time attentional-associative model Psychobiology. 16

Morpurgo C. (1965). Drug-induced modifications of discriminated avoidance behavior in rats. Psychopharmacologia. 8 [PubMed]

Nishijo H, Ono T, Nishino H. (1988). Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. The Journal of neuroscience : the official journal of the Society for Neuroscience. 8 [PubMed]

O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. (2003). Temporal difference models and reward-related learning in the human brain. Neuron. 38 [PubMed]

O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. (2002). Neural responses during anticipation of a primary taste reward. Neuron. 33 [PubMed]

Ogren SO, Archer T. (1994). Effects of typical and atypical antipsychotic drugs on two-way active avoidance. Relationship to DA receptor blocking profile. Psychopharmacology (Berl). 114

POSLUNS D. (1962). An analysis of chlorpromazine-induced suppression of the avoidance response. Psychopharmacologia. 3 [PubMed]

Pennartz CM, Groenewegen HJ, Lopes da Silva FH. (1994). The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Progress in neurobiology. 42 [PubMed]

Phares V. (2003). Understanding abnormal child psychology.

Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM. (2003). Subsecond dopamine release promotes cocaine seeking. Nature. 422 [PubMed]

Redgrave P, Prescott TJ, Gurney K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in neurosciences. 22 [PubMed]

Richards JB, Sabol KE, de Wit H. (1999). Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats. Psychopharmacology. 146 [PubMed]

Rizley RC, Rescorla RA. (1972). Associations in second-order conditioning and sensory preconditioning. Journal of comparative and physiological psychology. 81 [PubMed]

Rolls ET et al. (1974). The relative attenuation of self-stimulation, eating and drinking produced by dopamine-receptor blockade. Psychopharmacologia. 38 [PubMed]

Salamone JD, Cousins MS, Bucher S. (1994). Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behavioural brain research. 65 [PubMed]

Salamone JD, Cousins MS, Snyder BJ. (1997). Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neuroscience and biobehavioral reviews. 21 [PubMed]

Salamone JD, Kurth PA, McCullough LD, Sokolowski JD, Cousins MS. (1993). The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain research. 628 [PubMed]

Salamone JD et al. (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology. 104 [PubMed]

Salamone JD, Wisniecki A, Carlson BB, Correa M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience. 105

Schmajuk NA, Cox L, Gray JA. (2001). Nucleus accumbens, entorhinal cortex and latent inhibition: a neural network model. Behavioural brain research. 118 [PubMed]

Schneider JS, Sun ZQ, Roeltgen DP. (1994). Effects of dopamine agonists on delayed response performance in chronic low-dose MPTP-treated monkeys. Pharmacology, biochemistry, and behavior. 48 [PubMed]

Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]

Schultz W, Tremblay L, Hollerman JR. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral cortex (New York, N.Y. : 1991). 10 [PubMed]

Seeman P, Madras BK. (1998). Anti-hyperactivity medication: methylphenidate and amphetamine. Molecular psychiatry. 3 [PubMed]

Smith A, Li M, Becker S, Kapur S. (2004). A model of antipsychotic action in conditioned avoidance: a computational approach. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 29 [PubMed]

Solanto MV et al. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. Journal of abnormal child psychology. 29 [PubMed]

Stark H, Bischof A, Scheich H. (1999). Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neuroscience letters. 264 [PubMed]

Suri RE. (2001). Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Experimental brain research. 140 [PubMed]

Suri RE. (2005). TD models of reward predictive responses in dopamine neurons. Neural Netw. 15

Suri RE, Bargas J, Arbib MA. (2001). Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience. 103 [PubMed]

Suri RE, Schultz W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental brain research. 121 [PubMed]

Sutton RS. (1988). Learning to predict by the method of temporal diferences Machine Learning. 3

Talk AC, Gandhi CC, Matzel LD. (2002). Hippocampal function during behaviorally silent associative learning: dissociation of memory storage and expression. Hippocampus. 12 [PubMed]

Taylor JR, Robbins TW. (1984). Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens. Psychopharmacology. 84 [PubMed]

Touretzky DS, Daw ND, Courville AC. (2004). Timing and partial observability in the dopamine system Advances in neural information processing systems. 16

Tremblay L, Schultz W. (2000). Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. Journal of neurophysiology. 83 [PubMed]

Tremblay L, Schultz W. (2000). Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. Journal of neurophysiology. 83 [PubMed]

Wade TR, de Wit H, Richards JB. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology. 150 [PubMed]

Wadenberg ML, Hicks PB. (1999). The conditioned avoidance response test re-evaluated: is it a sensitive test for the detection of potentially atypical antipsychotics? Neuroscience and biobehavioral reviews. 23 [PubMed]

Wadenberg ML, Kapur S, Soliman A, Jones C, Vaccarino F. (2000). Dopamine D2 receptor occupancy predicts catalepsy and the suppression of conditioned avoidance response behavior in rats. Psychopharmacology. 150 [PubMed]

Wadenberg ML, Soliman A, VanderSpek SC, Kapur S. (2001). Dopamine D(2) receptor occupancy is a common mechanism underlying animal models of antipsychotics and their clinical effects. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 25 [PubMed]

Waelti P, Dickinson A, Schultz W. (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature. 412 [PubMed]

Wilkinson LS et al. (1998). Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. The European journal of neuroscience. 10 [PubMed]

Wilson M, Daly M. (2004). Do pretty women inspire men to discount the future? Proceedings. Biological sciences. 271 Suppl 4 [PubMed]

Wise RA. (1982). Neuroleptics and operant behavior: the anhedonia hypothesis Behav Brain Sci. 5

Wise RA. (2002). Brain reward circuitry: insights from unsensed incentives. Neuron. 36 [PubMed]

Wise RA, Schwartz HV. (1981). Pimozide attenuates acquisition of lever-pressing for food in rats. Pharmacology, biochemistry, and behavior. 15 [PubMed]

Wise RA, Spindler J, deWit H, Gerberg GJ. (1978). Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science (New York, N.Y.). 201 [PubMed]

Young AM, Ahier RG, Upton RL, Joseph MH, Gray JA. (1998). Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience. 83 [PubMed]

de Wit H, Enggasser JL, Richards JB. (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 27 [PubMed]

van der Heyden JA, Bradford LD. (1988). A rapidly acquired one-way conditioned avoidance procedure in rats as a primary screening test for antipsychotics: influence of shock intensity on avoidance performance. Behavioural brain research. 31 [PubMed]

References and models that cite this paper

Daw ND, Courville AC, Touretzky DS. (2006). Representation and timing in theories of the dopamine system. Neural computation. 18 [PubMed]

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.