Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal...

We conducted an experiment in which hedonia, salience and prediction error hypotheses predicted different patterns of dopamine (DA) release in the striatum during learning of conditioned avoidance responses (CARs). The data strongly favor the latter hypothesis. It predicts that during learning of the 2-way active avoidance CAR task, positive prediction errors generated when rats do not receive an anticipated footshock (which is better than expected) cause DA release that reinforces the instrumental avoidance action. In vivo microdialysis in the rat striatum showed that extracellular DA concentration increased during early CAR learning and decreased throughout training returning to baseline once the response was well learned. In addition, avoidance learning was proportional to the degree of DA release. Critically, exposure of rats to the same stimuli but in an unpredictable, unavoidable, and inescapable manner, did not produce alterations from baseline DA levels as predicted by the prediction error but not hedonic or salience hypotheses. In addition, rats with a partial lesion of substantia nigra DA neurons, which did not show increased DA levels during learning, failed to learn this task. These data represent clear and unambiguous evidence that it was the factor positive prediction error, and not hedonia or salience, which caused increase in the tonic level of striatal DA and which reinforced learning of the instrumental avoidance response.