Acquas E, Wilson C, Fibiger HC. (1996). Conditioned and unconditioned stimuli increase frontal cortical and hippocampal acetylcholine release: effects of novelty, habituation, and fear. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]
Adams SV, Winterer J, Müller W. (2004). Muscarinic signaling is required for spike-pairing induction of long-term potentiation at rat Schaffer collateral-CA1 synapses. Hippocampus. 14 [PubMed]
Atherton LA, Dupret D, Mellor JR. (2015). Memory trace replay: the shaping of memory consolidation by neuromodulation. Trends in neurosciences. 38 [PubMed]
Bi GQ, Poo MM. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]
Boddeke EW, Enz A, Shapiro G. (1992). SDZ ENS 163, a selective muscarinic M1 receptor agonist, facilitates the induction of long-term potentiation in rat hippocampal slices. European journal of pharmacology. 222 [PubMed]
Brzosko Z, Schultz W, Paulsen O. (2015). Retroactive modulation of spike timing-dependent plasticity by dopamine. eLife. 4 [PubMed]
Brzosko Z, Zannone S, Schultz W, Clopath C, Paulsen O. (2017). Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. eLife. 6 [PubMed]
Buchanan KA, Petrovic MM, Chamberlain SE, Marrion NV, Mellor JR. (2010). Facilitation of long-term potentiation by muscarinic M(1) receptors is mediated by inhibition of SK channels. Neuron. 68 [PubMed]
Ceccarelli I et al. (1999). Effects of novelty and pain on behavior and hippocampal extracellular ACh levels in male and female rats. Brain research. 815 [PubMed]
Connor SA, Maity S, Roy B, Ali DW, Nguyen PV. (2012). Conversion of short-term potentiation to long-term potentiation in mouse CA1 by coactivation of ß-adrenergic and muscarinic receptors. Learning & memory (Cold Spring Harbor, N.Y.). 19 [PubMed]
Dayan P. (2012). Twenty-five lessons from computational neuromodulation. Neuron. 76 [PubMed]
Deiana S, Platt B, Riedel G. (2011). The cholinergic system and spatial learning. Behavioural brain research. 221 [PubMed]
Dennis SH et al. (2016). Activation of Muscarinic M1 Acetylcholine Receptors Induces Long-Term Potentiation in the Hippocampus. Cerebral cortex (New York, N.Y. : 1991). 26 [PubMed]
Dickinson BA et al. (2009). A novel mechanism of hippocampal LTD involving muscarinic receptor-triggered interactions between AMPARs, GRIP and liprin-alpha. Molecular brain. 2 [PubMed]
Digby GJ et al. (2012). Novel allosteric agonists of M1 muscarinic acetylcholine receptors induce brain region-specific responses that correspond with behavioral effects in animal models. The Journal of neuroscience : the official journal of the Society for Neuroscience. 32 [PubMed]
Dong Z et al. (2013). Hippocampal long-term depression mediates spatial reversal learning in the Morris water maze. Neuropharmacology. 64 [PubMed]
Doya K. (2002). Metalearning and neuromodulation. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Easton A, Douchamps V, Eacott M, Lever C. (2012). A specific role for septohippocampal acetylcholine in memory? Neuropsychologia. 50 [PubMed]
Edelmann E, Lessmann V, Brigadski T. (2014). Pre- and postsynaptic twists in BDNF secretion and action in synaptic plasticity. Neuropharmacology. 76 Pt C [PubMed]
Fadda F, Cocco S, Stancampiano R. (2000). Hippocampal acetylcholine release correlates with spatial learning performance in freely moving rats. Neuroreport. 11 [PubMed]
Flicker C, Geyer MA. (1982). Behavior during hippocampal microinfusions. II. Muscarinic locomotor activation. Brain research. 257 [PubMed]
Florian RV. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural computation. 19 [PubMed]
Foster DJ, Morris RG, Dayan P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus. 10 [PubMed]
Frémaux N, Sprekeler H, Gerstner W. (2010). Functional requirements for reward-modulated spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]
Frémaux N, Sprekeler H, Gerstner W. (2013). Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS computational biology. 9 [PubMed]
Giovannini MG et al. (2001). Effects of novelty and habituation on acetylcholine, GABA, and glutamate release from the frontal cortex and hippocampus of freely moving rats. Neuroscience. 106 [PubMed]
Golkar A, Bellander M, Öhman A. (2013). Temporal properties of fear extinction--does time matter? Behavioral neuroscience. 127 [PubMed]
Hasselmo ME. (1999). Neuromodulation: acetylcholine and memory consolidation. Trends in cognitive sciences. 3 [PubMed]
Hasselmo ME. (2006). The role of acetylcholine in learning and memory. Current opinion in neurobiology. 16 [PubMed]
Huerta PT, Lisman JE. (1995). Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron. 15 [PubMed]
Ihalainen JA, Riekkinen P, Feenstra MG. (1999). Comparison of dopamine and noradrenaline release in mouse prefrontal cortex, striatum and hippocampus using microdialysis. Neuroscience letters. 277 [PubMed]
Inglis FM, Day JC, Fibiger HC. (1994). Enhanced acetylcholine release in hippocampus and cortex during the anticipation and consumption of a palatable meal. Neuroscience. 62 [PubMed]
Inglis FM, Fibiger HC. (1995). Increases in hippocampal and frontal cortical acetylcholine release associated with presentation of sensory stimuli. Neuroscience. 66 [PubMed]
Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]
Jo J et al. (2010). Muscarinic receptors induce LTD of NMDAR EPSCs via a mechanism involving hippocalcin, AP2 and PSD-95. Nature neuroscience. 13 [PubMed]
Jost J. (2006). Temporal correlation based learning in neuron models. Theory in biosciences = Theorie in den Biowissenschaften. 125 [PubMed]
Kametani H, Kawamura H. (1990). Alterations in acetylcholine release in the rat hippocampus during sleep-wakefulness detected by intracerebral dialysis. Life sciences. 47 [PubMed]
Kamsler A, McHugh TJ, Gerber D, Huang SY, Tonegawa S. (2010). Presynaptic m1 muscarinic receptors are necessary for mGluR long-term depression in the hippocampus. Proceedings of the National Academy of Sciences of the United States of America. 107 [PubMed]
Kistler WM, Gerstner W. (2002). Spiking neuron models.
Laurent PA. (2008). The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural networks : the official journal of the International Neural Network Society. 21 [PubMed]
Legenstein R, Pecevski D, Maass W. (2008). A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS computational biology. 4 [PubMed]
Li S, Cullen WK, Anwyl R, Rowan MJ. (2003). Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nature neuroscience. 6 [PubMed]
Lisman J. (1989). A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proceedings of the National Academy of Sciences of the United States of America. 86 [PubMed]
Lisman JE, Grace AA. (2005). The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 46 [PubMed]
Markram H, Lübke J, Frotscher M, Sakmann B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science (New York, N.Y.). 275 [PubMed]
Marrosu F et al. (1995). Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats. Brain research. 671 [PubMed]
McCool MF, Patel S, Talati R, Ragozzino ME. (2008). Differential involvement of M1-type and M4-type muscarinic cholinergic receptors in the dorsomedial striatum in task switching. Neurobiology of learning and memory. 89 [PubMed]
McNamara CG, Tejero-Cantero Á, Trouche S, Campo-Urriza N, Dupret D. (2014). Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence. Nature neuroscience. 17 [PubMed]
Montague PR, Dayan P, Sejnowski TJ. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience : the official journal of the Society for Neuroscience. 16 [PubMed]
Ovsepian SV, Anwyl R, Rowan MJ. (2004). Endogenous acetylcholine lowers the threshold for long-term potentiation induction in the CA1 area through muscarinic receptor activation: in vivo study. The European journal of neuroscience. 20 [PubMed]
Pan WX, Schmidt R, Wickens JR, Hyland BI. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Pavlov PI. (2010). Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. Annals of neurosciences. 17 [PubMed]
Pepeu G, Giovannini MG. (2004). Changes in acetylcholine extracellular levels during cognitive processes. Learning & memory (Cold Spring Harbor, N.Y.). 11 [PubMed]
Picciotto MR, Higley MJ, Mineur YS. (2012). Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior. Neuron. 76 [PubMed]
Ragozzino ME, Jih J, Tzavos A. (2002). Involvement of the dorsomedial striatum in behavioral flexibility: role of muscarinic cholinergic receptors. Brain research. 953 [PubMed]
Ragozzino ME, Pal SN, Unick K, Stefani MR, Gold PE. (1998). Modulation of hippocampal acetylcholine release and spontaneous alternation scores by intrahippocampal glucose injections. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]
Ragozzino ME, Unick KE, Gold PE. (1996). Hippocampal acetylcholine release during memory testing in rats: augmentation by glucose. Proceedings of the National Academy of Sciences of the United States of America. 93 [PubMed]
Scheiderer CL et al. (2006). Sympathetic sprouting drives hippocampal cholinergic reinnervation that prevents loss of a muscarinic receptor-dependent long-term depression at CA3-CA1 synapses. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]
Schultz W. (1997). Dopamine neurons and their role in reward mechanisms. Current opinion in neurobiology. 7 [PubMed]
Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]
Shinoe T, Matsui M, Taketo MM, Manabe T. (2005). Modulation of synaptic plasticity by physiological activation of M1 muscarinic acetylcholine receptors in the mouse hippocampus. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Stancampiano R, Cocco S, Cugusi C, Sarais L, Fadda F. (1999). Serotonin and acetylcholine release response in the rat hippocampus during a spatial memory task. Neuroscience. 89 [PubMed]
Sugisaki E, Fukushima Y, Fujii S, Yamazaki Y, Aihara T. (2016). The effect of coactivation of muscarinic and nicotinic acetylcholine receptors on LTD in the hippocampal CA1 network. Brain research. 1649 [PubMed]
Sugisaki E, Fukushima Y, Tsukada M, Aihara T. (2011). Cholinergic modulation on spike timing-dependent plasticity in hippocampal CA1 network. Neuroscience. 192 [PubMed]
Suri RE, Schultz W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience. 91 [PubMed]
Teles-Grilo Ruivo LM, Mellor JR. (2013). Cholinergic modulation of hippocampal network function. Frontiers in synaptic neuroscience. 5 [PubMed]
Thiel CM, Huston JP, Schwarting RK. (1998). Hippocampal acetylcholine and habituation learning. Neuroscience. 85 [PubMed]
Thorndike E. (1911). Animal intelligence.
Tran AH et al. (2008). Dopamine D1 receptor modulates hippocampal representation plasticity to spatial novelty. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28 [PubMed]
Tzavos A, Jih J, Ragozzino ME. (2004). Differential effects of M1 muscarinic receptor blockade and nicotinic receptor blockade in the dorsomedial striatum on response reversal learning. Behavioural brain research. 154 [PubMed]
Vasilaki E, Frémaux N, Urbanczik R, Senn W, Gerstner W. (2009). Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS computational biology. 5 [PubMed]
Volk LJ, Pfeiffer BE, Gibson JR, Huber KM. (2007). Multiple Gq-coupled receptors converge on a common protein synthesis-dependent long-term depression that is affected in fragile X syndrome mental retardation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]
Yang K, Dani JA. (2014). Dopamine D1 and D5 receptors modulate spike timing-dependent plasticity at medial perforant path to dentate granule cell synapses. The Journal of neuroscience : the official journal of the Society for Neuroscience. 34 [PubMed]
Yu AJ, Dayan P. (2005). Uncertainty, neuromodulation, and attention. Neuron. 46 [PubMed]
Zhang JC, Lau PM, Bi GQ. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proceedings of the National Academy of Sciences of the United States of America. 106 [PubMed]
de Lavilléon G, Lacroix MM, Rondi-Reig L, Benchenane K. (2015). Explicit memory creation during sleep demonstrates a causal role of place cells in navigation. Nature neuroscience. 18 [PubMed]