基于增强的过程积极调节沿冗余溶液分流体的电机探索
Adam M Roth1, Jan A Calalo1, Rakshith Lokesh2
1Department of Mechanical Engineering, University of Delaware, Newark, DE 19716, USA.
Proceedings. Biological sciences
|October 17, 2023
概括
强化学习通过更新基于奖励的运动目标来推动运动探索. 这种积极的探索,与被动理论不同,有助于在不确定的环境和运动恢复.
科学领域:
- 发动机控制器 发动机控制器
- 神经科学是一个神经科学.
- 机器人技术 机器人技术 机器人技术
背景情况:
- 探索性随机步行行为对于跨物种的运动学习至关重要.
- 以前的理论将此归因于累积的变化和缺少错误纠正.
研究的目的:
- 调查是否基于强化学习的过程,而不是被动机制,调节随机步行行为.
- 了解大脑如何利用奖励来引导持续的运动学习.
主要方法:
- 进行了三项人类接触实验,操纵了目标大小,看不见的奖励区和强化反概率.
- 采用计算建模来分析经验数据.
主要成果:
- 结果支持基于强化学习的模型,其中运动变异性告知了针对奖励行动的目标更新.
- 证明探索性随机步行行为从利用奖励信息中积极出现.
- 显示这种机制促进了对电机解决方案的持续探索.
结论:
- 强化学习积极调节运动探索,挑战随机步行行为的被动理论.
- 这种活跃的探索机制对于适应不确定的环境,运动发育和神经恢复至关重要.
相关概念视频
Hierarchy of Motor Control
2.8K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.8K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
57
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
57
Indirect Motor Pathways
1.5K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.5K
Stability of Equilibrium Configuration: Problem Solving
611
The stability of equilibrium configurations is an important concept in physics, engineering, and other related fields. In simple terms, it refers to the tendency of an object or system to return to its equilibrium position after being disturbed. The stability of an equilibrium configuration can be analyzed by considering the potential energy function of the system and examining its behavior near the equilibrium point.
Problem-solving in the context of the stability of equilibrium configuration...
Problem-solving in the context of the stability of equilibrium configuration...
611
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.1K
Direct Motor Pathways
2.0K
The direct motor pathways, also known as the pyramidal tracts, are a group of neural pathways that originate in the brain and descend through the spinal cord. They control the voluntary movement of the body. There are two major direct motor pathways: the corticospinal and the corticobulbar tracts.
The corticospinal tract is responsible for the voluntary movement of the limbs and trunk. It originates in the cerebral cortex of the brain and descends through the cerebrum's internal capsule and...
The corticospinal tract is responsible for the voluntary movement of the limbs and trunk. It originates in the cerebral cortex of the brain and descends through the cerebrum's internal capsule and...
2.0K


