A model of the neural substrates for exploratory dynamics in basal ganglia

We present a model of basal ganglia (BG) that departs from the classical Go/NoGo picture of the function of its key pathways-the Direct and Indirect Pathways (DP and IP). Between the Go and NoGo regimes, we posit a third Explore regime, which denotes random exploration of action alternatives. Striatal dopamine (DA) is assumed to switch between DP and IP activation. The IP is modeled as a loop of the subthalamic nucleus (STN) and the Globus Pallidus externa (GPe). Simulations reveal that while the model displays Go and NoGo regimes for extreme values of DA, at intermediate values of DA, it exhibits exploratory behavior, which originates from the chaotic activity of the STN-GPe loop. We describe a series of BG models based on Go/Explore/NoGo approach, to explain the role of BG in three cases: (1) a simple action selection task, (2) reaching, and (3) willed action.