Tianqi Wei1,2, Qinghai Guo3, Barbara Webb1

  • 1Institute of Perception, Action, and Behaviour, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom.

PubMed
概括

这项研究引入了一种新的强化学习算法,灵感来自昆虫神经回路,以解决稀疏奖励问题. 该算法使用自适应连接来有效地学习具有延迟奖励的任务.

相关概念视频

Neural Circuits01:25

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Chemical Synapses01:26

Chemical Synapses

Chemical synapses are specialized sites between two neurons or between a neuron and a non-neuronal cell like a muscle, glandular or sensory cell.
Because chemical synapses depend on the release of neurotransmitter molecules from synaptic vesicles to pass on their signal, there is an approximately one millisecond delay between when the axon potential reaches the presynaptic terminal and when the neurotransmitter leads to opening of postsynaptic ion channels. Additionally, this signaling is...
2.5K
Gap Junctions01:27

Gap Junctions

The cytoplasm of adjacent animal cells can exchange small molecules, ions, and secondary messengers via the communication channels which form the gap junctions. These junctions comprise a few hundred to thousands of molecular channels, each made of two halves, called the connexon hemichannel. A connexon is a hexamer of six transmembrane connexin proteins, which assemble radially, thus forming a pore or channel in the center. One connexon hemichannel docks with a corresponding connexon on the...
8.0K
Neurons: The Axon01:21

Neurons: The Axon

Axons are long, cytoplasmic processes of nerve cells capable of propagating electrical impulses known as action potentials. The cytoplasm or axoplasm of an axon contains neurofibrils, neurotubules, small vesicles, lysosomes, mitochondria, and various enzymes, all encased within the axolemma, the plasma membrane of the axon.
The axon attaches to the cell body at a cone-shaped elevation called the axon hillock. The initial part of the axon, closest to the hillock, is known as the initial segment....
3.4K
Overview of Synapses01:25

Overview of Synapses

A synapse is a specialized structure where two neurons connect, allowing them to pass an electrical or chemical signal to another neuron. It is the point of communication between neurons. The term "synapse" is derived from the Greek word "synapsis," which means "conjunction." The entire process of neural communication revolves around the synapse. When activated, a neuron releases chemicals known as neurotransmitters into the synapse. These neurotransmitters cross the synapse and bind to...
2.3K