Keramati M, Dezfouli A, Piray P. (2011). Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS computational biology. 7 [PubMed]

See more from authors: Keramati M · Dezfouli A · Piray P

References and models cited by this paper

ALLUISI EA. (1965). INTERACTION OF S-R COMPATIBILITY AND THE RATE OF GAIN OF INFORMATION. Perceptual and motor skills. 20 [PubMed]

Aberman JE, Salamone JD. (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience. 92 [PubMed]

Adams CD. (1982). Variations in the sensitivity of instrumental responding to reinforcer devaluation Q J Exp Psychol. 34

Alluisi E, Strain G, Thursmond J. (1964). Stimulus-response compatibility and the rate of gain of information Psychon Sci. 1

BROADBENT DE, GREGORY M. (1965). ON THE INTERACTION OF S-R COMPATIBILITY WITH OTHER VARIABLES AFFECTING REACTION TIME. British journal of psychology (London, England : 1953). 56 [PubMed]

Balleine BW, O'Doherty JP. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology. 35 [PubMed]

Barto AG, Mahadevan S. (2003). Recent advances in hierarchical reinforcement learning Discrete Event Dynamic Systems. 13

Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ. (2009). Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behavioural brain research. 199 [PubMed]

Brown MF. (1992). Does a cognitive map guide choices in the radial-arm maze? Journal of experimental psychology. Animal behavior processes. 18 [PubMed]

Buckner RL, Carroll DC. (2007). Self-projection and the brain. Trends in cognitive sciences. 11 [PubMed]

Carr GD, White NM. (1987). Effects of systemic and intracranial amphetamine injections on behavior in the open field: a detailed analysis. Pharmacology, biochemistry, and behavior. 27 [PubMed]

Correa M, Carlson BB, Wisniecki A, Salamone JD. (2002). Nucleus accumbens dopamine and work requirements on interval schedules. Behavioural brain research. 137 [PubMed]

Daw ND, Niv Y, Dayan P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature neuroscience. 8 [PubMed]

Daw ND, Touretzky DS. (2002). Long-term reward prediction in TD models of the dopamine system. Neural computation. 14 [PubMed]

Dickinson A. (1985). Actions and habits: The development of behavioural autonomy Phil Trans Royal Soc London B. 308

Dickinson A, Balleine B. (1995). Motivational control of instrumental action Curr Dir Psychol Sci. 4

Dickinson A, Balleine B. (2002). The role of learning in motivation Stevens handbook of experimental psychology (3rd ed). 3

Dickinson A, Balleine BW, Gonzalez F, Garner C. (1995). Motivational control of heterogeneous instrumental chains J Exp Psychol: Animal Behaviour Processes. 21

Evans ML, Sherwin RS. (2002). Blood glucose and the brain in diabetes: between a rock and a hard place? Current diabetes reports. 2 [PubMed]

Evenden JL, Robbins TW. (1983). Increased response switching, perseveration and perseverative switching following d-amphetamine in the rat. Psychopharmacology. 80 [PubMed]

Everitt BJ, Robbins TW. (1992). Functions of dopamine in the dorsal and ventral striatum Semin Neurosci . 4

Friedman N, Russell S, Dearden R. (1998). Bayesian Q-Learning Proceedings of the 15th National Conference on Artificial Intelligence (AAAI).

Geist M, Pietquin O, Fricout G. (2009). Kalman temporal differences: the deterministic case Proceedings of the 2009 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09).

Gigerenzer G. (2000). Adaptive thinking: Rationality in the real world Evolution.

Gigerenzer G, Todd PM, Group AR. (). Simple heuristics that make us smart. 1st edition.

Gold JI, Shadlen MN. (2007). The neural basis of decision making. Annual review of neuroscience. 30 [PubMed]

Grossberg S, Ellias SA. (1975). Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks Biol Cybern. 20

HYMAN R. (1953). Stimulus information as a determinant of reaction time. Journal of experimental psychology. 45 [PubMed]

Haber SN. (2003). The primate basal ganglia: parallel and integrative networks. Journal of chemical neuroanatomy. 26 [PubMed]

Haber SN, Fudge JL, McFarland NR. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]

Haruno M, Kawato M. (2006). Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural networks : the official journal of the International Neural Network Society. 19 [PubMed]

Hick WE. (4). On the rate of gain of information Q J Exp Psychol. 11

Holland PC. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of experimental psychology. Animal behavior processes. 30 [PubMed]

Howard R. (1996). Information value theory IEEE T Syst Sci Cyb. 2

Hu D, Xu X, Gonzalez-Lima F. (2006). Vicarious trial-and-error behavior and hippocampal cytochrome oxidase activity during Y-maze discrimination learning in the rat. The International journal of neuroscience. 116 [PubMed]

Jackson DM, Andén NE, Dahlström A. (1975). A functional effect of dopamine in the nucleus accumbens and in some other dopamine-rich parts of the rat brain. Psychopharmacologia. 45 [PubMed]

Joel D, Niv Y, Ruppin E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]

Jueptner M, Frith CD, Brooks DJ, Frackowiak RS, Passingham RE. (1997). Anatomy of motor learning. II. Subcortical structures and learning by trial and error. Journal of neurophysiology. 77 [PubMed]

Jueptner M et al. (1997). Anatomy of motor learning. I. Frontal cortex and attention to action. Journal of neurophysiology. 77 [PubMed]

Julier SJ, Uhlmann JK. (2004). Unscented filtering and nonlinear estimation Proc IEEE. 92

Killcross S, Coutureau E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral cortex (New York, N.Y. : 1991). 13 [PubMed]

Kosaki Y, Dickinson A. (2010). Choice and contingency in the development of behavioral autonomy during instrumental conditioning. Journal of experimental psychology. Animal behavior processes. 36 [PubMed]

Laurent PA. (2008). The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural networks : the official journal of the International Neural Network Society. 21 [PubMed]

Ljungberg T, Enquist M. (1987). Disruptive effects of low doses of d-amphetamine on the ability of rats to organize behaviour into functional sequences. Psychopharmacology. 93 [PubMed]

Mahurin RK, Pirozzolo FJ. (1993). Application of Hick's law of response speed in Alzheimer and Parkinson diseases. Perceptual and motor skills. 77 [PubMed]

Mas-colell A, Whinston MD, Green JR. (1995). Microeconomic Theory.

McClure SM, Daw ND, Montague PR. (2003). A computational substrate for incentive salience. Trends in neurosciences. 26 [PubMed]

Mingote S, Weber SM, Ishiwari K, Correa M, Salamone JD. (2005). Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. The European journal of neuroscience. 21 [PubMed]

Montague PR, Dayan P, Sejnowski TJ. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]

Mowbray GH, Rhoades MV. (1959). On the reduction of choice reaction-times with practice Q J Exp Psychol. 11

Muenzinger K. (1938). Vicarious trial and error at a point of choice. i. a general survey of its relation to learning efficacy J Genet Psychol. 53

Munn NL. (1950). Handbook of psychological research on the rat.

Niv Y, Daw ND, Joel D, Dayan P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology. 191 [PubMed]

Pessiglione M et al. (2005). An effect of dopamine depletion on decision-making: the temporal coupling of deliberation and execution. Journal of cognitive neuroscience. 17 [PubMed]

Rangel A, Camerer C, Montague PR. (2008). A framework for studying the neurobiology of value-based decision making. Nature reviews. Neuroscience. 9 [PubMed]

Redish AD, Jensen S, Johnson A. (2008). A unified framework for addiction: vulnerabilities in the decision process. The Behavioral and brain sciences. 31 [PubMed]

Redish AD, Jensen S, Johnson A, Kurth-Nelson Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychological review. 114 [PubMed]

Rescorla RA, Colwill RM. (1985). Instrumental responding remains sensitive to reinforcer devaluation after extensive training J Exp Psychol Anim Behav Process. 11

Rescorla RA, Colwill RM. (1988). The role of response-reinforcer associations increases throughout extended instrumental training Anim Learn Behav. 16

Robbins TW, Lyons M. (1975). The action of central nervous system stimulant drugs: a general theory concerning amphetamine effects Current developments in psychopharmacology. 2

Russell S, Zilberstein S. (1995). Approximate reasoning using anytime algorithms Imprecise and Approximate Computation, The Kluwer International Series in Engineering and Computer Science. 318

SPIGEL IM. (1965). LIFT REACTION TIME AND TOPOGRAPHIC COMPATIBILITY OF THE S-R FIELD. The Journal of general psychology. 72 [PubMed]

Salamone JD, Wisniecki A, Carlson BB, Correa M. (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience. 105

Schultz W. (1998). Predictive reward signal of dopamine neurons. Journal of neurophysiology. 80 [PubMed]

Shah A, Barto AG. (2009). Effect on movement selection of an evolving sensory representation: a multiple controller model of skill acquisition. Brain research. 1299 [PubMed]

Shiv B, Fedorikhin A. (1999). Heart and mind in conflict: The interplay of affect and cognition in consumer decision making J Cons Res. 26

Simon H. (1947). Administrative behavior.

Simon H. (1955). A behavioral model of rational choice Q J Econ. 69

Simon H. (1982). Models of bounded rationality.

Sokolowski JD, Salamone JD. (1998). The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacology, biochemistry, and behavior. 59 [PubMed]

Suri RE. (2001). Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Experimental brain research. 140 [PubMed]

Tassinari H, Hudson TE, Landy MS. (2006). Combining priors and noisy visual cues in a rapid pointing task. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]

Taylor JR, Robbins TW. (1984). Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens. Psychopharmacology. 84 [PubMed]

Taylor JR, Robbins TW. (1986). 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine. Psychopharmacology. 90 [PubMed]

Tolman E. (1938). The determiners of behavior at a choice point. Psychol Rev . 45

Tolman E. (1939). Prediction of vicarious trial and error by means of the schematic sowbug Psychol Rev. 46

Tsitsiklis JN, Roy BV. (1997). Average cost temporal-difference learning Automatica. 35

Vickrey C, Neuringer A. (2000). Pigeon reaction time, Hick's law, and intelligence. Psychonomic bulletin & review. 7 [PubMed]

Welford AT. (1980). Choice reaction time: basic concepts Reaction Times.

Yin HH, Knowlton BJ, Balleine BW. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European journal of neuroscience. 19 [PubMed]

Yuille A, Geiger D. (1995). Winner-Take-All mechanisms Handbook of Brain Theory and Neural Networks.

References and models that cite this paper

Fiore VG, Ognibene D, Adinoff B, Gu X. (2018). A Multilevel Computational Characterization of Endophenotypes in Addiction eNeuro.

Girard B, Khamassi M, Viejo G. (2016). [Re] Speed/accuracy trade-off between the habitual and the goal-directed processes ReScience. 2(1)

This website requires cookies and limited processing of your personal data in order to function. By continuing to browse or otherwise use this site, you are agreeing to this use. See our Privacy policy and how to cite and terms of use.