,

Kim T Blackwell1, Kenji Doya2

  • 1Department of Bioengineering, Volgenau School of Engineering, George Mason University, Fairfax, Virginia, United States of America.

PubMed
概括

这项研究介绍了TD2Q,一种新的强化学习模型,更好地模仿基底. TD2Q通过结合直接和间接途径神经元动态来改善动物在学习任务中的行为模拟.

相关概念视频

Indirect Motor Pathways01:22

Indirect Motor Pathways

The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.6K
Long-term Potentiation01:35

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.3K
Real-World Application of Classical Conditioning01:15

Real-World Application of Classical Conditioning

Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
626
Adrenergic Agonists: Indirect-Acting Agents01:25

Adrenergic Agonists: Indirect-Acting Agents

Indirect-acting adrenergic agonists potentiate the effects of endogenous catecholamines through different mechanisms without directly binding to adrenoceptors.
One mechanism involves depleting stored catecholamines by displacing them from synaptic vesicles. These agents, known as "displacers," are transported into vesicles at the expense of noradrenaline. Examples include amphetamine and tyramine, which lack a catechol moiety, resulting in prolonged action, improved oral...
1.7K
Cognitive Learning01:21

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
421
Direct Motor Pathways01:11

Direct Motor Pathways

The direct motor pathways, also known as the pyramidal tracts, are a group of neural pathways that originate in the brain and descend through the spinal cord. They control the voluntary movement of the body. There are two major direct motor pathways: the corticospinal and the corticobulbar tracts.
The corticospinal tract is responsible for the voluntary movement of the limbs and trunk. It originates in the cerebral cortex of the brain and descends through the cerebrum's internal capsule and...
2.1K