. (2002). Neuronal coding '01. Papers presented at the International Workshop on Neuronal Coding '01. Plymouth, United Kingdom. September 9-14, 2001. Bio Systems. 67 [PubMed]
Abarbanel HD, Gibb L, Huerta R, Rabinovich MI. (2003). Biophysical model of synaptic plasticity dynamics. Biological cybernetics. 89 [PubMed]
Abarbanel HD, Huerta R, Rabinovich MI. (2002). Dynamical model of long-term synaptic plasticity. Proceedings of the National Academy of Sciences of the United States of America. 99 [PubMed]
Abbott LF, Blum KI. (1996). Functional significance of long-term potentiation for sequence learning and prediction. Cerebral cortex (New York, N.Y. : 1991). 6 [PubMed]
Abbott LF, Song S. (1999). Temporally asymmetric Hebbian learning, postspike timing and neuronal response variability. Adv Neural Informat Processing Syst. 11
Abeles M. (1991). Corticonics: Neural Circuits of the Cerebral Cortex..
Akopian G, Musleh W, Smith R, Walsh JP. (2000). Functional state of corticostriatal synapses determines their expression of short- and long-term plasticity. Synapse (New York, N.Y.). 38 [PubMed]
Altar CA, Boyar WC, Kim HS. (1990). Discriminatory roles for D1 and D2 dopamine receptor subtypes in the in vivo control of neostriatal cyclic GMP. European journal of pharmacology. 181 [PubMed]
Anderson C, Crawford-Hines S. (1994). Multigrid q-learning Tech. Rep. No. CS-94-121.
Artola A, Singer W. (1993). Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends in neurosciences. 16 [PubMed]
Ashby WR. (1952). Design for a brain.
Balkenius C, Moren J. (1998). Computational models of classical conditioning: A comparative study LUCS 62 ISSN 1101-8453.
Barto AG. (1995). Adaptive critics and the basal ganglia Models of Information Processing in the Basal Ganglia.
Barto AG, Sutton RS. (1990). Time-derivative models of Pavlovian reinforcement Learning and computational neuroscience: Foundations of adaptive networks.
Barto AG, Sutton RS. (1998). Reinforcement learning: an introduction.
Barto AG, Sutton RS, Anderson CW. (1983). Neuronlike elements that can solve difficult learning control problems IEEE Trans Systems Man Cybern. 13
Bell CC, Han VZ, Sugawara Y, Grant K. (1997). Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature. 387 [PubMed]
Bellman R. (1957). Dynamic Programming.
Bennett MR. (2000). The concept of long term potentiation of transmission at synapses. Progress in neurobiology. 60 [PubMed]
Berger B, Trottier S, Verney C, Gaspar P, Alvarez C. (1988). Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: a radioautographic study. The Journal of comparative neurology. 273 [PubMed]
Berns GS, McClure SM, Pagnoni G, Montague PR. (2001). Predictability modulates human brain response to reward. The Journal of neuroscience : the official journal of the Society for Neuroscience. 21 [PubMed]
Berns GS, Sejnowski TJ. (1998). A computational model of how the basal ganglia produce sequences. Journal of cognitive neuroscience. 10 [PubMed]
Berridge KC, Robinson TE. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain research. Brain research reviews. 28 [PubMed]
Berridge MJ. (1998). Neuronal calcium signaling. Neuron. 21 [PubMed]
Bi G, Poo M. (2001). Synaptic modification by correlated activity: Hebb's postulate revisited. Annual review of neuroscience. 24 [PubMed]
Bi GQ. (2002). Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms. Biological cybernetics. 87 [PubMed]
Bi GQ, Poo MM. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]
Bibb JA et al. (1999). Phosphorylation of DARPP-32 by Cdk5 modulates dopamine signalling in neurons. Nature. 402 [PubMed]
Bienenstock EL, Cooper LN, Munro PW. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of neuroscience : the official journal of the Society for Neuroscience. 2 [PubMed]
Bliss TV, Gardner-Medwin AR. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the unanaestetized rabbit following stimulation of the perforant path. The Journal of physiology. 232 [PubMed]
Bliss TV, Lomo T. (1970). Plasticity in a monosynaptic cortical pathway. J Physiol. 207
Bliss TV, Lomo T. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. The Journal of physiology. 232 [PubMed]
Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron. 30 [PubMed]
Brown J, Bullock D, Grossberg S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. The Journal of neuroscience : the official journal of the Society for Neuroscience. 19 [PubMed]
Brown JR, Arbuthnott GW. (1983). The electrophysiology of dopamine (D2) receptors: a study of the actions of dopamine on corticostriatal transmission. Neuroscience. 10 [PubMed]
Buchs NJ, Senn W. (2002). Spike-based synaptic plasticity and the emergence of direction selective simple cells: simulation results. Journal of computational neuroscience. 13 [PubMed]
Bunney BS, Chiodo LA, Grace AA. (1991). Midbrain dopamine system electrophysiological functioning: a review and new hypothesis. Synapse (New York, N.Y.). 9 [PubMed]
Buzsáki G, Penttonen M, Nádasdy Z, Bragin A. (1996). Pattern and inhibition-dependent invasion of pyramidal cell dendrites by fast spikes in the hippocampus in vivo. Proceedings of the National Academy of Sciences of the United States of America. 93 [PubMed]
Calabresi P, Centonze D, Gubellini P, Marfia GA, Bernardi G. (1999). Glutamate-triggered events inducing corticostriatal long-term depression. The Journal of neuroscience : the official journal of the Society for Neuroscience. 19 [PubMed]
Calabresi P et al. (1995). Transmitter release associated with long-term synaptic depression in rat corticostriatal slices. The European journal of neuroscience. 7 [PubMed]
Calabresi P et al. (2000). Dopamine and cAMP-regulated phosphoprotein 32 kDa controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Calabresi P, Maj R, Mercuri NB, Bernardi G. (1992). Coactivation of D1 and D2 dopamine receptors is required for long-term synaptic depression in the striatum. Neuroscience letters. 142 [PubMed]
Calabresi P, Maj R, Pisani A, Mercuri NB, Bernardi G. (1992). Long-term synaptic depression in the striatum: physiological and pharmacological characterization. The Journal of neuroscience : the official journal of the Society for Neuroscience. 12 [PubMed]
Calabresi P, Mercuri N, Stanzione P, Stefani A, Bernardi G. (1987). Intracellular studies on the dopamine-induced firing inhibition of neostriatal neurons in vitro: evidence for D1 receptor involvement. Neuroscience. 20 [PubMed]
Calabresi P, Pisani A, Mercuri NB, Bernardi G. (1992). Long-term Potentiation in the Striatum is Unmasked by Removing the Voltage-dependent Magnesium Block of NMDA Receptor Channels. The European journal of neuroscience. 4 [PubMed]
Calabresi P, Pisani A, Mercuri NB, Bernardi G. (1996). The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia. Trends in neurosciences. 19 [PubMed]
Cannon CM, Palmiter RD. (2003). Reward without dopamine. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]
Carpenter GA, Grossberg S. (1987). ART 2: self-organization of stable category recognition codes for analog input patterns. Applied optics. 26 [PubMed]
Castellani GC, Quinlan EM, Cooper LN, Shouval HZ. (2001). A biophysical model of bidirectional synaptic plasticity: dependence on AMPA and NMDA receptors. Proceedings of the National Academy of Sciences of the United States of America. 98 [PubMed]
Centonze D et al. (2003). Receptor subtypes involved in the presynaptic and postsynaptic actions of dopamine on striatal interneurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]
Centonze D et al. (1999). Unilateral dopamine denervation blocks corticostriatal LTP. Journal of neurophysiology. 82 [PubMed]
Charpier S, Deniau JM. (1997). In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. Proceedings of the National Academy of Sciences of the United States of America. 94 [PubMed]
Charpier S, Mahon S, Deniau JM. (1999). In vivo induction of striatal long-term potentiation by low-frequency stimulation of the cerebral cortex. Neuroscience. 91 [PubMed]
Choi S, Lovinger DM. (1997). Decreased probability of neurotransmitter release underlies striatal long-term depression and postnatal development of corticostriatal synapses. Proceedings of the National Academy of Sciences of the United States of America. 94 [PubMed]
Cohen MA, Grossberg S, Wyse LL. (1995). A spectral network model of pitch perception. The Journal of the Acoustical Society of America. 98 [PubMed]
Contreras-Vidal JL, Schultz W. (1999). A predictive reinforcement model of dopamine neurons for learning approach behavior. Journal of computational neuroscience. 6 [PubMed]
Daw ND. (2003). Reinforcement learning models of the dopamine system and their behavioral implications Unpublished doctoral dissertation.
Dayan P. (1992). The convergence of TD(Lambda) Mach Learn. 8
Dayan P. (2002). Matters temporal. Trends in cognitive sciences. 6 [PubMed]
Dayan P, Balleine BW. (2002). Reward, motivation, and reinforcement learning. Neuron. 36 [PubMed]
Dayan P, Kakade S, Montague PR. (2000). Learning and selective attention. Nature neuroscience. 3 Suppl [PubMed]
Dayan P, Watkins CJCH. (1992). Unpublished doctoral dissertation Mach Learn. 8
De Koninck P, Schulman H. (1998). Sensitivity of CaM kinase II to the frequency of Ca2+ oscillations. Science (New York, N.Y.). 279 [PubMed]
Debanne D, Gähwiler BH, Thompson SM. (1994). Asynchronous pre- and postsynaptic activity induces associative long-term depression in area CA1 of the rat hippocampus in vitro. Proceedings of the National Academy of Sciences of the United States of America. 91 [PubMed]
Debanne D, Gähwiler BH, Thompson SM. (1998). Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. The Journal of physiology. 507 ( Pt 1) [PubMed]
Deisseroth K, Heist EK, Tsien RW. (1998). Translocation of calmodulin to the nucleus supports CREB phosphorylation in hippocampal neurons. Nature. 392 [PubMed]
Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of neurophysiology. 84 [PubMed]
Dennett DC. (1984). Cognitive wheels: The frame problem of AI Minds, machines and evolution.
Dolmetsch RE, Pajvani U, Fife K, Spotts JM, Greenberg ME. (2001). Signaling to the nucleus by an L-type calcium channel-calmodulin complex through the MAP kinase pathway. Science (New York, N.Y.). 294 [PubMed]
Doya K. (2000). Reinforcement learning in continuous time and space. Neural computation. 12 [PubMed]
Egger V, Feldmeyer D, Sakmann B. (1999). Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in rat barrel cortex. Nature neuroscience. 2 [PubMed]
Elliott R, Friston KJ, Dolan RJ. (2000). Dissociable neural responses in human reward systems. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Ernst U, Pawelzik K, Milton J, Cowan J, Eurich C. (1999). Dynamics of self-organazed delay adaptation Phys Rev Lett. 82
Feldman DE. (2000). Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex. Neuron. 27 [PubMed]
Froemke RC, Dan Y. (2002). Spike-timing-dependent synaptic modification induced by natural spike trains. Nature. 416 [PubMed]
Fukai T, Kitano K, Cateau H. (2002). An accurate and widely applicable method to determine the distribution of synaptic strengths formed by the spike-timing-dependent learning Neurocomputing. 44
Fusi S. (2002). Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biological cybernetics. 87 [PubMed]
Futatsugi A et al. (1999). Facilitation of NMDAR-independent LTP and spatial learning in mutant mice lacking ryanodine receptor type 3. Neuron. 24 [PubMed]
Gerfen CR. (1984). The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems. Nature. 311 [PubMed]
Gerfen CR. (1985). The neostriatal mosaic. I. Compartmental organization of projections from the striatum to the substantia nigra in the rat. The Journal of comparative neurology. 236 [PubMed]
Gerfen CR. (1992). The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. Annual review of neuroscience. 15 [PubMed]
Gerfen CR, Herkenham M, Thibault J. (1987). The neostriatal mosaic: II. Patch- and matrix-directed mesostriatal dopaminergic and non-dopaminergic systems. The Journal of neuroscience : the official journal of the Society for Neuroscience. 7 [PubMed]
Gerstner W, Kempter R, van Hemmen JL, Wagner H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature. 383 [PubMed]
Gerstner W, Kistler WM. (2002). Mathematical formulations of Hebbian learning. Biological cybernetics. 87 [PubMed]
Goldberg J, Holthoff K, Yuste R. (2002). A problem with Hebb and local spikes. Trends in neurosciences. 25 [PubMed]
Golding NL, Kath WL, Spruston N. (2001). Dichotomy of action-potential backpropagation in CA1 pyramidal neuron dendrites. Journal of neurophysiology. 86 [PubMed]
Golding NL, Staff NP, Spruston N. (2002). Dendritic spikes as a mechanism for cooperative long-term potentiation. Nature. 418 [PubMed]
Graef IA et al. (1999). L-type calcium channels and GSK-3 regulate the activity of NF-ATc4 in hippocampal neurons. Nature. 401 [PubMed]
Greengard P, Allen PB, Nairn AC. (1999). Beyond the dopamine receptor: the DARPP-32/protein phosphatase-1 cascade. Neuron. 23 [PubMed]
Groenewegen HJ, Berendse HW, Wolters JG, Lohman AH. (1990). The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization. Progress in brain research. 85 [PubMed]
Grossberg S, Merrill JW. (1996). The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. Journal of cognitive neuroscience. 8 [PubMed]
Grossberg S, Schmajuk NA. (1989). Neural dynamics of adaptive timing and temporal discrimination during associative learning Neural Netw. Networks2
Gruber AJ, Solla SA, Surmeier DJ, Houk JC. (2003). Modulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability. Journal of neurophysiology. 90 [PubMed]
Gustafsson B, Wigström H, Abraham WC, Huang YY. (1987). Long-term potentiation in the hippocampus using depolarizing current pulses as the conditioning stimulus to single volley synaptic potentials. The Journal of neuroscience : the official journal of the Society for Neuroscience. 7 [PubMed]
Gütig R, Aharonov R, Rotter S, Sompolinsky H. (2003). Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]
Haber SN, Fudge JL, McFarland NR. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Han VZ, Grant K, Bell CC. (2000). Reversible associative depression and nonassociative potentiation at a parallel fiber synapse. Neuron. 27 [PubMed]
Hassani OK, Cromwell HC, Schultz W. (2001). Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. Journal of neurophysiology. 85 [PubMed]
Hauber W, Bohn I, Giertler C. (2000). NMDA, but not dopamine D(2), receptors in the rat nucleus accumbens areinvolved in guidance of instrumental behavior by stimuli predicting reward magnitude. J Neurosci. 20
Hebb DO. (1949). The Organization Of Behavior.
Hemmings HC, Greengard P, Tung HY, Cohen P. (1984). DARPP-32, a dopamine-regulated neuronal phosphoprotein, is a potent inhibitor of protein phosphatase-1. Nature. 310 [PubMed]
Hernández-López S, Bargas J, Surmeier DJ, Reyes A, Galarraga E. (1997). D1 receptor activation enhances evoked discharge in neostriatal medium spiny neurons by modulating an L-type Ca2+ conductance. The Journal of neuroscience : the official journal of the Society for Neuroscience. 17 [PubMed]
Hoffman DA, Magee JC, Colbert CM, Johnston D. (1997). K+ channel regulation of signal propagation in dendrites of hippocampal pyramidal neurons. Nature. 387 [PubMed]
Hollerman JR, Schultz W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature neuroscience. 1 [PubMed]
Hollerman JR, Tremblay L, Schultz W. (1998). Influence of reward expectation on behavior-related neuronal activity in primate striatum. Journal of neurophysiology. 80 [PubMed]
Houk JC, Adams JL, Barto AGA. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models Of Information Processing In The Basal Ganglia.
Hull CL. (1939). The problem of stimulus equivalence in behavior theory Psychol Rev. 46
Hull CL. (1943). Principles of behavior.
Häusser M, Spruston N, Stuart GJ. (2000). Diversity and dynamics of dendritic signaling. Science (New York, N.Y.). 290 [PubMed]
Izhikevich EM, Desai NS. (2003). Relating STDP to BCM. Neural computation. 15 [PubMed]
Joel D, Niv Y, Ruppin E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Joel D, Weiner I. (2000). The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience. 96 [PubMed]
Johnston D, Magee JC, Colbert CM, Cristie BR. (1996). Active properties of neuronal dendrites. Annual review of neuroscience. 19 [PubMed]
Joyce JN, Marshall JF. (1987). Quantitative autoradiography of dopamine D2 sites in rat caudate-putamen: localization to intrinsic neurons and not to neocortical afferents. Neuroscience. 20 [PubMed]
Kaelbling LP, Littman ML, Moore AW. (1996). Reinforcement learning: A survey J Art Intell Res. 4
Karmarkar UR, Buonomano DV. (2002). A model of spike-timing dependent plasticity: one or two coincidence detectors? Journal of neurophysiology. 88 [PubMed]
Karmarkar UR, Najarian MT, Buonomano DV. (2002). Mechanisms and significance of spike-timing dependent plasticity. Biological cybernetics. 87 [PubMed]
Kawagoe R, Takikawa Y, Hikosaka O. (1998). Expectation of reward modulates cognitive signals in the basal ganglia. Nature neuroscience. 1 [PubMed]
Kehoe EJ, Gormezano I, Marshall BS. (1983). Twenty years ofclassical conditioning research with the rabbit Prog Psychobiol Phys Psychol. 10
Kempter R, Gerstner W, van Hemmen JL. (2001). Intrinsic stabilization of output rates by spike-based Hebbian learning. Neural computation. 13 [PubMed]
Kempter R, Leibold C, Wagner H, van Hemmen JL. (2001). Formation of temporal-feature maps by axonal propagation of synaptic learning. Proceedings of the National Academy of Sciences of the United States of America. 98 [PubMed]
King MM et al. (1984). Mammalian brain phosphoproteins as substrates for calcineurin. The Journal of biological chemistry. 259 [PubMed]
Kistler WM. (2002). Spike-timing dependent synaptic plasticity: a phenomenological framework. Biological cybernetics. 87 [PubMed]
Kistler WM, van Hemmen JL. (2000). Modeling synaptic plasticity in conjuction with the timing of pre- and postsynaptic action potentials. Neural computation. 12 [PubMed]
Kitano K, Okamoto H, Fukai T. (2003). Time representing cortical activities: two models inspired by prefrontal persistent activity. Biological cybernetics. 88 [PubMed]
Klopf AH. (1972). Brain function and adaptive systems-a heterostatic theory Tech. Rep. Air Force Cambridge Research Laboratories Special Report No. 133.
Klopf AH. (1982). The hedonistic neuron.
Klopf AH. (1986). A drive-reinforcement model of single neuron function Neural networks for computing: AIP Conference Proceedings.
Klopf AH. (1988). A neuronal model of classical conditioning Psychobiology. 16
Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. (2001). Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 12 [PubMed]
Koester HJ, Sakmann B. (1998). Calcium dynamics in single spines during coincident pre- and postsynaptic activity depend on relative timing of back-propagating action potentials and subthreshold excitatory postsynaptic potentials. Proceedings of the National Academy of Sciences of the United States of America. 95 [PubMed]
Kosco B. (1986). Differential Hebbian learning Neural networks for computing: AIP Conference Proceedings.
Lasser-Ross N, Ross WN. (1992). Imaging voltage and synaptically activated sodium transients in cerebellar Purkinje cells. Proceedings. Biological sciences. 247 [PubMed]
Linden DJ. (1999). The return of the spike: postsynaptic action potentials and the induction of LTP and LTD. Neuron. 22 [PubMed]
Lisman J. (1989). A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proceedings of the National Academy of Sciences of the United States of America. 86 [PubMed]
Ljungberg T, Apicella P, Schultz W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of neurophysiology. 67 [PubMed]
Lynd-Balta E, Haber SN. (1994). Primate striatonigral projections: a comparison of the sensorimotor-related striatum and the ventral striatum. The Journal of comparative neurology. 345 [PubMed]
Magee JC, Johnston D. (1997). A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons. Science (New York, N.Y.). 275 [PubMed]
Malenka RC et al. (1989). An essential role for postsynaptic calmodulin and protein kinase activity in long-term potentiation. Nature. 340 [PubMed]
Malenka RC, Nicoll RA. (1999). Long-term potentiation--a decade of progress? Science (New York, N.Y.). 285 [PubMed]
Malinow R, Schulman H, Tsien RW. (1989). Inhibition of postsynaptic PKC or CaMKII blocks induction but not expression of LTP. Science (New York, N.Y.). 245 [PubMed]
Markram H, Lübke J, Frotscher M, Sakmann B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science (New York, N.Y.). 275 [PubMed]
Martone ME et al. (1995). Elements of the intrinsic organization and information processing in the neostriatum Models of information processing in the basal ganglia.
Mayer ML, Westbrook GL, Guthrie PB. (1984). Voltage-dependent block by Mg2+ of NMDA responses in spinal cord neurones. Nature. 309 [PubMed]
Mehta MR. (2004). Cooperative LTP can map memory sequences on dendritic branches. Trends in neurosciences. 27 [PubMed]
Mehta MR, Lee AK, Wilson MA. (2002). Role of experience and oscillations in transforming a rate code into a temporal code. Nature. 417 [PubMed]
Migliore M, Hoffman DA, Magee JC, Johnston D. (1999). Role of an A-type K+ conductance in the back-propagation of action potentials in the dendrites of hippocampal pyramidal neurons. Journal of computational neuroscience. 7 [PubMed]
Miller JD, Sanghera MK, German DC. (1981). Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. Life sciences. 29 [PubMed]
Montague PR, Dayan P, Person C, Sejnowski TJ. (1995). Bee foraging in uncertain environments using predictive hebbian learning. Nature. 377 [PubMed]
Mulkey RM, Endo S, Shenolikar S, Malenka RC. (1994). Involvement of a calcineurin/inhibitor-1 phosphatase cascade in hippocampal long-term depression. Nature. 369 [PubMed]
Nicola SM, Surmeier J, Malenka RC. (2000). Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annual review of neuroscience. 23 [PubMed]
Nishiyama M, Hong K, Mikoshiba K, Poo MM, Kato K. (2000). Calcium stores regulate the polarity and input specificity of synaptic modification. Nature. 408 [PubMed]
Nowak L, Bregestovski P, Ascher P, Herbet A, Prochiantz A. (1984). Magnesium gates glutamate-activated channels in mouse central neurones. Nature. 307 [PubMed]
O'Doherty J, Rolls ET, Francis S, Bowtell R, McGlone F. (2001). Representation of pleasant and aversive taste in the human brain. Journal of neurophysiology. 85 [PubMed]
O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. (2002). Neural responses during anticipation of a primary taste reward. Neuron. 33 [PubMed]
Overton PG, Clark D. (1997). Burst firing in midbrain dopaminergic neurons. Brain research. Brain research reviews. 25 [PubMed]
Pacheco-Cano MT, Bargas J, Hernández-López S, Tapia D, Galarraga E. (1996). Inhibitory action of dopamine involves a subthreshold Cs(+)-sensitive conductance in neostriatal neurons. Experimental brain research. 110 [PubMed]
Pagnoni G, Zink CF, Montague PR, Berns GS. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nature neuroscience. 5 [PubMed]
Parent A. (1990). Extrinsic connections of the basal ganglia. Trends in neurosciences. 13 [PubMed]
Partridge JG, Tang KC, Lovinger DM. (2000). Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. Journal of neurophysiology. 84 [PubMed]
Pike FG, Meredith RM, Olding AW, Paulsen O. (1999). Rapid report: postsynaptic bursting is essential for 'Hebbian' induction of associative long-term potentiation at excitatory synapses in rat hippocampus. The Journal of physiology. 518 ( Pt 2) [PubMed]
Porr B, Wörgötter F. (2003). Isotropic sequence order learning. Neural computation. 15 [PubMed]
Porr B, Wörgötter F. (2003). Isotropic-sequence-order learning in a closed-loop behavioural system. Philosophical transactions. Series A, Mathematical, physical, and engineering sciences. 361 [PubMed]
Porr B, von Ferber C, Wörgötter F. (2003). ISO learning approximates a solution to the inverse-controller problem in an unsupervised behavioral paradigm. Neural computation. 15 [PubMed]
Prokasy WF, Hall JF, Fawcett JT. (1962). Adaptation, sensitization, forward and backward conditioning, and pseudo-conditioning of the GSR Psychol Rep. 10
Pucak ML, Grace AA. (1994). Regulation of substantia nigra dopamine neurons. Critical reviews in neurobiology. 9 [PubMed]
Rao RP, Sejnowski TJ. (2001). Spike-timing-dependent Hebbian plasticity as temporal difference learning. Neural computation. 13 [PubMed]
Redgrave P, Prescott TJ, Gurney K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in neurosciences. 22 [PubMed]
Regehr WG, Konnerth A, Armstrong CM. (1992). Sodium action potentials in the dendrites of cerebellar Purkinje cells. Proceedings of the National Academy of Sciences of the United States of America. 89 [PubMed]
Reynolds JN, Wickens JR. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Reynolds SI. (2002). Reinforcement learning with exploration Unpublished doctoral dissertation.
Roberts PD. (1999). Computational consequences of temporally asymmetric learning rules: I. Differential hebbian learning. Journal of computational neuroscience. 7 [PubMed]
Roberts PD, Bell CC. (2002). Spike timing dependent synaptic plasticity in biological systems. Biological cybernetics. 87 [PubMed]
Roche KW, O'Brien RJ, Mammen AL, Bernhardt J, Huganir RL. (1996). Characterization of multiple phosphorylation sites on the AMPA receptor GluR1 subunit. Neuron. 16 [PubMed]
Rose CR, Konnerth A. (2001). Stores not just for storage. intracellular calcium release and synaptic plasticity. Neuron. 31 [PubMed]
Rubin J, Lee DD, Sompolinsky H. (2001). Equilibrium properties of temporally asymmetric Hebbian plasticity. Physical review letters. 86 [PubMed]
Rummery GA. (1995). Problem solving with reinforcement learning Unpublished doctoral dissertation.
Russell VA, Allin R, Lamm MC, Taljaard JJ. (1992). Regional distribution of monoamines and dopamine D1- and D2-receptors in the striatum of the rat. Neurochemical research. 17 [PubMed]
Sato N, Yamaguchi Y. (2003). Memory encoding by theta phase precession in the hippocampal network. Neural computation. 15 [PubMed]
Saudargiene A, Porr B, Wörgötter F. (2004). How the shape of pre- and postsynaptic signals can influence STDP: a biophysical model. Neural computation. 16 [PubMed]
Schiller J, Schiller Y, Stuart G, Sakmann B. (1997). Calcium action potentials restricted to distal apical dendrites of rat neocortical pyramidal neurons. The Journal of physiology. 505 ( Pt 3) [PubMed]
Schmidhuber J, Wiering M. (1998). Fast online Q(Lambda) Mach Learn. 33
Schoenbaum G, Chiba AA, Gallagher M. (1998). Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature neuroscience. 1 [PubMed]
Schultz W. (1986). Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. Journal of neurophysiology. 56 [PubMed]
Schultz W. (1998). Predictive reward signal of dopamine neurons. Journal of neurophysiology. 80 [PubMed]
Schultz W. (2002). Getting formal with dopamine and reward. Neuron. 36 [PubMed]
Schultz W, Apicella P, Scarnati E, Ljungberg T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. The Journal of neuroscience : the official journal of the Society for Neuroscience. 12 [PubMed]
Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]
Schultz W, Dickinson A. (2000). Neuronal coding of prediction errors. Annual review of neuroscience. 23 [PubMed]
Sejnowski T, Dayan P. (1994). Td (Lambda) converges with probability 1 Mach Learn. 14
Senn W, Buchs NJ. (2004). Spike-based synaptic plasticity and the emergence of direction selective simple cells: mathematical analysis. J Comput Neurosci. 14
Senn W, Markram H, Tsodyks M. (2001). An algorithm for modifying neurotransmitter release probability based on pre- and postsynaptic spike timing. Neural computation. 13 [PubMed]
Seung HS. (1998). Learning continuous attractors in recurrent networks Adv Neural Info Proc Sys. 10
Shouval HZ, Bear MF, Cooper LN. (2002). A unified model of NMDA receptor-dependent bidirectional synaptic plasticity. Proceedings of the National Academy of Sciences of the United States of America. 99 [PubMed]
Sibley DR, Monsma FJ. (1992). Molecular biology of dopamine receptors. Trends in pharmacological sciences. 13 [PubMed]
Singh SP, Jordan MI, Jaakkola T. (1995). On the convergence of stochastic iterative dynamic programming algorithms Neural Comput. 6
Singh SP, Sutton RS. (1996). Reinforcement learning with replacing eligibility traces Mach Learn. 22
Sjöström PJ, Turrigiano GG, Nelson SB. (2001). Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron. 32 [PubMed]
Song I, Huganir RL. (2002). Regulation of AMPA receptors during synaptic plasticity. Trends in neurosciences. 25 [PubMed]
Song S, Miller KD, Abbott LF. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature neuroscience. 3 [PubMed]
Spencer JP, Murphy KP. (2000). Bi-directional changes in synaptic plasticity induced at corticostriatal synapses in vitro. Experimental brain research. 135 [PubMed]
Stoof JC, Kebabian JW. (1981). Opposing roles for D-1 and D-2 dopamine receptors in efflux of cyclic AMP from rat neostriatum. Nature. 294 [PubMed]
Stuart G, Spruston N, Sakmann B, Häusser M. (1997). Action potential initiation and backpropagation in neurons of the mammalian CNS. Trends in neurosciences. 20 [PubMed]
Stuart GJ, Sakmann B. (1994). Active propagation of somatic action potentials into neocortical pyramidal cell dendrites. Nature. 367 [PubMed]
Suri RE, Bargas J, Arbib MA. (2001). Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience. 103 [PubMed]
Suri RE, Schultz W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental brain research. 121 [PubMed]
Suri RE, Schultz W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience. 91 [PubMed]
Suri RE, Schultz W. (2001). Temporal difference model reproduces anticipatory neural activity. Neural computation. 13 [PubMed]
Surmeier DJ, Bargas J, Hemmings HC, Nairn AC, Greengard P. (1995). Modulation of calcium currents by a D1 dopaminergic protein kinase/phosphatase cascade in rat neostriatal neurons. Neuron. 14 [PubMed]
Surmeier DJ, Kitai ST. (1993). D1 and D2 dopamine receptor modulation of sodium and potassium currents in rat neostriatal neurons. Progress in brain research. 99 [PubMed]
Sutton RS. (1984). Temporal credit assignment in reinforcement learning Unpublished doctoral dissertation.
Sutton RS. (1988). Learning to predict by the method of temporal diferences Machine Learning. 3
Sutton RS. (1996). Generalization in reinforcement learning: Successful examples using sparse coarse coding Advances in neural information processing systems. 8
Sutton RS. (1999). Open theoretical questions in reinforcement learning EUROColt.
Sutton RS, Barto AG. (1981). Toward a modern theory of adaptive networks: expectation and prediction. Psychological review. 88 [PubMed]
Svenningsson P et al. (1998). Activation of adenosine A2A and dopamine D1 receptors stimulates cyclic AMP-dependent phosphorylation of DARPP-32 in distinct populations of striatal projection neurons. Neuroscience. 84 [PubMed]
Svoboda K, Mainen ZF. (1999). Synaptic [Ca2+]: intracellular stores spill their guts. Neuron. 22 [PubMed]
Tang K, Low MJ, Grandy DK, Lovinger DM. (2001). Dopamine-dependent synaptic plasticity in striatum during in vivo development. Proceedings of the National Academy of Sciences of the United States of America. 98 [PubMed]
Tesauro G. (1992). Practical issues in temporal difference learning Mach Learn. 8
Tingley WG et al. (1997). Characterization of protein kinase A and protein kinase C phosphorylation of the N-methyl-D-aspartate receptor NR1 subunit using phosphorylation site-specific antibodies. The Journal of biological chemistry. 272 [PubMed]
Toan DL, Schultz W. (1985). Responses of rat pallidum cells to cortex stimulation and effects of altered dopaminergic activity. Neuroscience. 15 [PubMed]
Touzet C. (1999). Neural networks and Q-learning for robotics Available online at: http:--www.sciences-cognitives.org-scico-annuaire-Touzet_Claude-Touzet_IJCNN_Tut.pdf.
Touzet C, Santos JM. (1999). Dynamic update of the reinforcement function during learning Connection Science [Special issue]. 11
Touzet C, Santos JM. (1999). Exploration tuned reinforcement function Neurocomputing [Special issue]. 28
Tremblay L, Hollerman JR, Schultz W. (1998). Modifications of reward expectation-related neuronal activity during learning in primate striatum. Journal of neurophysiology. 80 [PubMed]
Tremblay L, Schultz W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature. 398 [PubMed]
Umemiya M, Raymond LA. (1997). Dopaminergic modulation of excitatory postsynaptic currents in rat neostriatal neurons. Journal of neurophysiology. 78 [PubMed]
Wagner A, Rescorla R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement Classical Conditioning II: Current Research and Theory.
Walsh JP. (1993). Depression of excitatory synaptic input in rat striatal neurons. Brain research. 608 [PubMed]
Walsh JP, Dunia R. (1993). Synaptic activation of N-methyl-D-aspartate receptors induces short-term potentiation at excitatory synapses in the striatum of the rat. Neuroscience. 57 [PubMed]
Watanabe S et al. (1999). Expression of N-methyl-D-aspartate receptor-dependent long-term potentiation in the neostriatal neurons in an in vitro slice after ethanol withdrawal of the rat. Neuroscience. 91
Watkins CJCH. (1989). Learning from delayed rewards Unpublished doctoral dissertation.
West AE et al. (2001). Calcium regulation of neuronal gene expression. Proceedings of the National Academy of Sciences of the United States of America. 98 [PubMed]
Whitford KL, Ghosh A. (2001). Plexin signaling via off-track and rho family GTPases. Neuron. 32 [PubMed]
Wickens JR, Begg AJ, Arbuthnott GW. (1996). Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience. 70 [PubMed]
Widrow B, Hoff M. (1960). Adaptive switching circuits Western Electronic Show And Convention Reco. 4
Williams SM, Goldman-Rakic PS. (1993). Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cerebral cortex (New York, N.Y. : 1991). 3 [PubMed]
Witten IH. (1977). An adaptive optimal controller for discrete-time Markov environments Information And Control. 34
Xie X, Seung S. (2000). Spike-based learning rules and stabilization of persistent neural activity. Advances in neural information processing systems. 12
Yang SN, Tang YG, Zucker RS. (1999). Selective induction of LTP and LTD by postsynaptic [Ca2+]i elevation. Journal of neurophysiology. 81 [PubMed]
Yao H, Dan Y. (2001). Stimulus timing-dependent plasticity in cortical processing of orientation. Neuron. 32 [PubMed]
Yim CY, Mogenson GJ. (1982). Response of nucleus accumbens neurons to amygdala stimulation and its modification by dopamine. Brain research. 239 [PubMed]
Zhang LI, Tao HW, Holt CE, Harris WA, Poo M. (1998). A critical window for cooperation and competition among developing retinotectal synapses. Nature. 395 [PubMed]
Zink CF, Pagnoni G, Martin ME, Dhamala M, Berns GS. (2003). Human striatal response to salient nonrewarding stimuli. The Journal of neuroscience : the official journal of the Society for Neuroscience. 23 [PubMed]
Zucker RS. (1999). Calcium- and activity-dependent synaptic plasticity. Current opinion in neurobiology. 9 [PubMed]
van Hemmen JL. (2001). Theory of synaptic plasticity Handbook Of Biological Physics, neuro-informatics, neural modelling. 4
van Hemmen JL, Gerstner W, Kempter R. (1999). Hebbian learning and spiking neurons Physical Review E. 59
van Ooyen A, Sterratt DC. (2002). Does morphology influence temporal plasticity? ICANN 2002. 2415
van Rossum MC, Bi GQ, Turrigiano GG. (2000). Stable Hebbian learning from spike timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 20 [PubMed]
Baras D, Meir R. (2007). Reinforcement learning, spike-time-dependent plasticity, and the BCM rule. Neural computation. 19 [PubMed]
Grüning A. (2007). Elman backpropagation as reinforcement for simple recurrent networks. Neural computation. 19 [PubMed]
Gurney KN, Humphries MD, Redgrave P. (2015). A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS biology. 13 [PubMed]
Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]
Manninen T, Hituri K, Kotaleski JH, Blackwell KT, Linne ML. (2010). Postsynaptic signal transduction models for long-term potentiation and depression. Frontiers in computational neuroscience. 4 [PubMed]
Porr B, Wörgötter F. (2006). Strongly improved stability and faster convergence of temporal sequence learning by using input correlations only. Neural computation. 18 [PubMed]
Porr B, Wörgötter F. (2007). Learning with "relevance": using a third factor to stabilize Hebbian learning. Neural computation. 19 [PubMed]