Action initiation shapes mesolimbic dopamine encoding of future rewards

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...

Neurons communicate by firing action potentials—the electrochemical signal that is propagated along the axon. The signal results in the release of neurotransmitters at axon terminals, thereby transmitting information to the nervous system. An action potential is a specific "all-or-none" change in membrane potential that results in a rapid spike in voltage.
Membrane potential in neurons
Neurons typically have a resting membrane potential of about -70 millivolts (mV). When they receive...

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...

Neurochemical transmission, the conduction of electrical impulses between neurons mediated by neurotransmitters, plays a vital role in various physiological processes. Autonomic drugs exert their effects by modulating neurotransmission within the autonomic nervous system. For instance, drugs such as hemicholinium block the precursor uptake necessary for synthesizing acetylcholine, an essential autonomic neurotransmitter. Following synthesis, neurotransmitters are stored in vesicles. Metyrosine...

Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...

Indirect-acting adrenergic agonists potentiate the effects of endogenous catecholamines through different mechanisms without directly binding to adrenoceptors.
One mechanism involves depleting stored catecholamines by displacing them from synaptic vesicles. These agents, known as "displacers," are transported into vesicles at the expense of noradrenaline. Examples include amphetamine and tyramine, which lack a catechol moiety, resulting in prolonged action, improved oral...