Adams SV, Winterer J, Müller W. (2004). Muscarinic signaling is required for spike-pairing induction of long-term potentiation at rat Schaffer collateral-CA1 synapses. Hippocampus. 14 [PubMed]
Andrade-Talavera Y, Duque-Feria P, Paulsen O, Rodríguez-Moreno A. (2016). Presynaptic Spike Timing-Dependent Long-Term Depression in the Mouse Hippocampus. Cerebral cortex (New York, N.Y. : 1991). 26 [PubMed]
Auerbach JM, Segal M. (1996). Muscarinic receptors mediating depression and long-term potentiation in rat hippocampus. The Journal of physiology. 492 ( Pt 2) [PubMed]
Barto AG, Sutton RS. (1998). Reinforcement learning: an introduction.
Bi GQ, Poo MM. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of neuroscience : the official journal of the Society for Neuroscience. 18 [PubMed]
Bliss TV, Collingridge GL. (1993). A synaptic model of memory: long-term potentiation in the hippocampus. Nature. 361 [PubMed]
Bliss TV, Lomo T. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. The Journal of physiology. 232 [PubMed]
Boddeke EW, Enz A, Shapiro G. (1992). SDZ ENS 163, a selective muscarinic M1 receptor agonist, facilitates the induction of long-term potentiation in rat hippocampal slices. European journal of pharmacology. 222 [PubMed]
Brzosko Z, Schultz W, Paulsen O. (2015). Retroactive modulation of spike timing-dependent plasticity by dopamine. eLife. 4 [PubMed]
Buchanan KA, Petrovic MM, Chamberlain SE, Marrion NV, Mellor JR. (2010). Facilitation of long-term potentiation by muscarinic M(1) receptors is mediated by inhibition of SK channels. Neuron. 68 [PubMed]
Charnov EL. (1976). Optimal foraging, the marginal value theorem. Theoretical population biology. 9 [PubMed]
Clopath C, Büsing L, Vasilaki E, Gerstner W. (2010). Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nature neuroscience. 13 [PubMed]
Connor SA, Maity S, Roy B, Ali DW, Nguyen PV. (2012). Conversion of short-term potentiation to long-term potentiation in mouse CA1 by coactivation of ß-adrenergic and muscarinic receptors. Learning & memory (Cold Spring Harbor, N.Y.). 19 [PubMed]
Debanne D, Gähwiler BH, Thompson SM. (1998). Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. The Journal of physiology. 507 ( Pt 1) [PubMed]
Dennis SH et al. (2016). Activation of Muscarinic M1 Acetylcholine Receptors Induces Long-Term Potentiation in the Hippocampus. Cerebral cortex (New York, N.Y. : 1991). 26 [PubMed]
Dickinson BA et al. (2009). A novel mechanism of hippocampal LTD involving muscarinic receptor-triggered interactions between AMPARs, GRIP and liprin-alpha. Molecular brain. 2 [PubMed]
Digby GJ et al. (2012). Novel allosteric agonists of M1 muscarinic acetylcholine receptors induce brain region-specific responses that correspond with behavioral effects in animal models. The Journal of neuroscience : the official journal of the Society for Neuroscience. 32 [PubMed]
Doya K. (2002). Metalearning and neuromodulation. Neural networks : the official journal of the International Neural Network Society. 15 [PubMed]
Edelmann E, Lessmann V. (2011). Dopamine Modulates Spike Timing-Dependent Plasticity and Action Potential Properties in CA1 Pyramidal Neurons of Acute Rat Hippocampal Slices. Frontiers in synaptic neuroscience. 3 [PubMed]
Ekstrom AD et al. (2003). Cellular networks underlying human spatial navigation. Nature. 425 [PubMed]
Florian RV. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural computation. 19 [PubMed]
Foster DJ, Morris RG, Dayan P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus. 10 [PubMed]
Frémaux N, Sprekeler H, Gerstner W. (2010). Functional requirements for reward-modulated spike-timing-dependent plasticity. The Journal of neuroscience : the official journal of the Society for Neuroscience. 30 [PubMed]
Frémaux N, Sprekeler H, Gerstner W. (2013). Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS computational biology. 9 [PubMed]
Gerstner W. (1995). Time structure of the activity in neural network models. Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics. 51 [PubMed]
Gerstner W, Kempter R, van Hemmen JL, Wagner H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature. 383 [PubMed]
Gerstner W, Paninski L, Naud R, Kistler W. (2014). Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition, 1st ed..
Hasselmo ME. (1999). Neuromodulation: acetylcholine and memory consolidation. Trends in cognitive sciences. 3 [PubMed]
Hertz J, Krogh A, Palmer RG. (1991). Introduction to the Theory of Neural Computation..
Huerta PT, Lisman JE. (1995). Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron. 15 [PubMed]
Izhikevich EM. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex (New York, N.Y. : 1991). 17 [PubMed]
Jo J et al. (2010). Muscarinic receptors induce LTD of NMDAR EPSCs via a mechanism involving hippocalcin, AP2 and PSD-95. Nature neuroscience. 13 [PubMed]
Kametani H, Kawamura H. (1990). Alterations in acetylcholine release in the rat hippocampus during sleep-wakefulness detected by intracerebral dialysis. Life sciences. 47 [PubMed]
Kamsler A, McHugh TJ, Gerber D, Huang SY, Tonegawa S. (2010). Presynaptic m1 muscarinic receptors are necessary for mGluR long-term depression in the hippocampus. Proceedings of the National Academy of Sciences of the United States of America. 107 [PubMed]
Kwag J, Paulsen O. (2009). The timing of external input controls the sign of plasticity at local synapses. Nature neuroscience. 12 [PubMed]
Legenstein R, Pecevski D, Maass W. (2008). A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS computational biology. 4 [PubMed]
Levey AI, Edmunds SM, Koliatsos V, Wiley RG, Heilman CJ. (1995). Expression of m1-m4 muscarinic acetylcholine receptor proteins in rat hippocampus and regulation by cholinergic innervation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 15 [PubMed]
Markram H, Lübke J, Frotscher M, Sakmann B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science (New York, N.Y.). 275 [PubMed]
Marrosu F et al. (1995). Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats. Brain research. 671 [PubMed]
Morris RG, Anderson E, Lynch GS, Baudry M. (1986). Selective impairment of learning and blockade of long-term potentiation by an N-methyl-D-aspartate receptor antagonist, AP5. Nature. 319 [PubMed]
Morris RG, Garrud P, Rawlins JN, O'Keefe J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature. 297 [PubMed]
Müller W, Misgeld U, Heinemann U. (1988). Carbachol effects on hippocampal neurons in vitro: dependence on the rate of rise of carbachol tissue concentration. Experimental brain research. 72 [PubMed]
O'Keefe J, Dostrovsky J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain research. 34 [PubMed]
O`Keefe J, Nadel L. (1978). The Hippocampus as a Cognitive Map.
Ovsepian SV, Anwyl R, Rowan MJ. (2004). Endogenous acetylcholine lowers the threshold for long-term potentiation induction in the CA1 area through muscarinic receptor activation: in vivo study. The European journal of neuroscience. 20 [PubMed]
Pan WX, Schmidt R, Wickens JR, Hyland BI. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Pawlak V, Wickens JR, Kirkwood A, Kerr JN. (2010). Timing is not Everything: Neuromodulation Opens the STDP Gate. Frontiers in synaptic neuroscience. 2 [PubMed]
Scheiderer CL et al. (2006). Sympathetic sprouting drives hippocampal cholinergic reinnervation that prevents loss of a muscarinic receptor-dependent long-term depression at CA3-CA1 synapses. The Journal of neuroscience : the official journal of the Society for Neuroscience. 26 [PubMed]
Schultz W, Dayan P, Montague PR. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.). 275 [PubMed]
Seol GH et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron. 55 [PubMed]
Shinoe T, Matsui M, Taketo MM, Manabe T. (2005). Modulation of synaptic plasticity by physiological activation of M1 muscarinic acetylcholine receptors in the mouse hippocampus. The Journal of neuroscience : the official journal of the Society for Neuroscience. 25 [PubMed]
Song S, Miller KD, Abbott LF. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature neuroscience. 3 [PubMed]
Stephens DW, Krebs JR. (1986). Foraging Theory.
Sugisaki E, Fukushima Y, Fujii S, Yamazaki Y, Aihara T. (2016). The effect of coactivation of muscarinic and nicotinic acetylcholine receptors on LTD in the hippocampal CA1 network. Brain research. 1649 [PubMed]
Sugisaki E, Fukushima Y, Tsukada M, Aihara T. (2011). Cholinergic modulation on spike timing-dependent plasticity in hippocampal CA1 network. Neuroscience. 192 [PubMed]
Suri RE, Schultz W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience. 91 [PubMed]
Sutton RS, Barto AG. (1981). Toward a modern theory of adaptive networks: expectation and prediction. Psychological review. 88 [PubMed]
Teles-Grilo Ruivo LM, Mellor JR. (2013). Cholinergic modulation of hippocampal network function. Frontiers in synaptic neuroscience. 5 [PubMed]
Thiel CM, Huston JP, Schwarting RK. (1998). Hippocampal acetylcholine and habituation learning. Neuroscience. 85 [PubMed]
Tsien JZ, Huerta PT, Tonegawa S. (1996). The essential role of hippocampal CA1 NMDA receptor-dependent synaptic plasticity in spatial memory. Cell. 87 [PubMed]
Vasilaki E, Frémaux N, Urbanczik R, Senn W, Gerstner W. (2009). Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS computational biology. 5 [PubMed]
Volk LJ, Pfeiffer BE, Gibson JR, Huber KM. (2007). Multiple Gq-coupled receptors converge on a common protein synthesis-dependent long-term depression that is affected in fragile X syndrome mental retardation. The Journal of neuroscience : the official journal of the Society for Neuroscience. 27 [PubMed]
Yu AJ, Dayan P. (2005). Uncertainty, neuromodulation, and attention. Neuron. 46 [PubMed]
Zhang JC, Lau PM, Bi GQ. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proceedings of the National Academy of Sciences of the United States of America. 106 [PubMed]
Zhao Y, Tzounopoulos T. (2011). Physiological activation of cholinergic inputs controls associative synaptic plasticity via modulation of endocannabinoid signaling. The Journal of neuroscience : the official journal of the Society for Neuroscience. 31 [PubMed]
Cone I, Shouval HZ. (2021). Learning precise spatiotemporal sequences via biophysically realistic learning rules in a modular, spiking network. eLife. 10 [PubMed]
Zannone S, Brzosko Z, Paulsen O, Clopath C. (2018). Acetylcholine-modulated plasticity in reward-driven navigation: a computational study. Scientific reports. 8 [PubMed]