Roles of subthalamic nucleus and DBS in reinforcement conflict-based decision making (Frank 2006)


Deep brain stimulation (DBS) of the subthalamic nucleus dramatically improves the motor symptoms of Parkinson's disease, but causes cognitive side effects such as impulsivity. This model from Frank (2006) simulates the role of the subthalamic nucleus (STN) within the basal ganglia circuitry in decision making. The STN dynamically modulates network decision thresholds in proportion to decision conflict. The STN ``hold your horses'' signal adaptively allows the system more time to settle on the best choice when multiple options are valid. The model also replicates effects in Parkinson's patients on and off DBS in experiments designed to test the model (Frank et al, 2007).

Model Type: Connectionist Network

Cell Type(s): Neostriatum medium spiny direct pathway GABA cell; Substantia nigra pars compacta DA cell; Subthalamus nucleus projection neuron; Globus pallidus neuron

Transmitters: Dopamine; Gaba; Glutamate

Model Concept(s): Simplified Models; Synaptic Plasticity; Rate-coding model neurons; Parkinson's; Reinforcement Learning; Action Selection/Decision Making; Deep brain stimulation; Rebound firing

Simulation Environment: Emergent/PDP++

Implementer(s): Frank, Michael [mfrank at u.arizona.edu]

References:

Frank MJ. (2006). Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw 19 [PubMed]

Frank MJ, Samanta J, Moustafa AA, Sherman SJ. (2007). Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318 [PubMed]