Affiliation:
1. Laboratory of Sensory Processing, Brain Mind Institute, Faculty of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL) , Lausanne CH-1015 , Switzerland
Abstract
AbstractWe are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.
Funder
Swiss National Science Foundation
Publisher
Oxford University Press (OUP)
Subject
Cancer Research,Cell Biology,Molecular Medicine,Physiology
Reference102 articles.
1. Learning to predict by the methods of temporal differences;Sutton;Mach Learn,1988
2. Time-derivative models of Pavlovian reinforcement;Sutton,1990
3. A mathematical model for simple learning;Bush;Psychol Rev,1951
4. A model for stimulus generalization and discrimination;Bush;Psychol Rev,1951
5. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement;Rescorla,1972
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Neuroplasticity in Parkinson’s disease;Journal of Neural Transmission;2024-08-05
2. Harm Reduction in Psychiatric Settings;Journal of Psychosocial Nursing and Mental Health Services;2024-07